E. Wentzel, L. Ovcharov 


Applied Problems in 
PROBABILITY 





MIR PUBLISHERS*MOSCOW 


. Applied Problems In 
Probability Theory 


E. C Bearnens, JI A Osuapos 


IIpnkaagnbie 3a7a1n 
mo TeOpHH BepoaTHocreis 


Mocnsaa Paguo mn Cesap - 


Applied Problemsin — 
Probability Theory 


E.Wentzel and L.Ovcharov 





First published 1985 
Revised from the 1983 Russian edition 


Ha <daketulioxoM Sanke 


@ Nematengctreo «Papo u Canse+ 1983 
@ English translation, Mir Publishers, 1986 


AUTHORS’ PREFACE 


This book is based on many years of experience of teaching probability 
theory and its applications at higher educational establishments. 
It contains many of the problems we ourselves encountered in our 
research and consultative work. The problems are related to a variety 
of fields including electrical engineering, radio engineering, data trans- 
mission, computers, information systems, reliability of technical de- 
vices, preventive maintenance and repair, accuracy of apparatus, con-~ 
sumer service, transport, and the health service. . 

The text is divided into eleven chapters; each of which begins with 
a short theoretical introduction which is followed by relevant formu~ 
las. 

The problems differ both in the fields of application and in difficulty, 
At the beginning of each chapter the reader will find comparatively 
simple problems whose purpose is to help the reader grasp the funda~ 
mental concepts and acquire and consolidate the experience of apply- - 
ing probabilistic methods. Then follow more complicated applied prob- 
lems, which can be solved only after the requisite theoretical knowledge 
has been acquired and the necessary techniques mastered. 

We have avoided the standard typical problems which can be 
solved mechanically. Many problems may prove difficult for both be- 
ginners and experienced readers alike (the problems we believe most 
difficuit are marked by an asterisk). In the interest of the reader most 
of the problems have both answers and detailed solutions, and they are 
given immediately after the problem rather than at the end of the book; 
we wrote the book for a laborious and thoughful reader who will first 
try to find his own answer. This structure is very convenient and has 
justified itself in another book we have written, The Theory of Probability 
(Nauka, Moscow, 1973), which has been republished many times both 
at home and abroad (some problems in that edition have been repeated 
in this book). 

We believe that statements and detailed solutions of nontrivial prob- 
lems which demonstrate certain of the techniques of problem solving 
are particularly interesting. Our aim is not just to solve a problem but 
to use the simplest and most general technique. Some problems have 
been given several different solutions. In many cases a method of soln- 
tion used has a general nature and can be applied in several fields. 
We have paid special attention to numerical characteristics which 
makes it possible to solve a number of problems with exceptional sim- 
plicity. The applied problems using the theory of Markov stochastic 
processes has been given the greatest consideration. 

The brief theoretical sections which open each chapter do not usually 
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repeat what existing textbooks on probability theory present, but have 
been based on new methods 

Thus this book 1s, 1n a certain sense, intermediate between a collec- 
tion of problems and a textbook on the theory of probabilities It should 
be useful to a wide variety of readers such as students and lecturers at 
higher schools, engineers and research workers who require a proba 
bilistic approach to their work Note that the detailed solutions and 
the consideration given to problem solving techniques make this book 
sultable for independent study 

We wish to express our gratitude to B V Gnedenko, Academictan 
of the Ukrainian Academy of Sciences, who read the manuscript very 
attentively and made a number of valuable remarks, and also to 
Ys Pugachev, Academitian of the USSR Academy of Sciences, whom 
we consulted frequently when we worked on the book and whose 
methodical principles and netation wa substantially followed 


PREFACE TO THE ENGLISH EDITION 


We wish to express our satisfaction at having the opportunity to bring 
our techniques of solving applied problems in probability theory 
to the notice of the English reader. 

We wrote this book so that it could be used both as a study aid in 
probability theory and as a collection of problems, of which are about 
700. 

The theoretical part at the beginning of each chapter and the method- 
ical instructions for solving the various problems make it possible 
to use the book as a study aid. The solutions of many of the problems 
in the book are important both from an educational point of view and 
because they can be used when investigating various applied engi- 
neering problems. 

The methodology and the notation in this book correspond, in the 
main, to those used in V. S. Pugachev’s book [6] which was recently 
published in Great Britain. 

When the book was being prepared for translation into English, 
a number of corrections and additions were made which improved the 
content of the book. During this preparatory work, Assistant Professor 
Danilov made an essential contribution, for which we want to express 
our gratitude. 


E. Wentzel, L. Ovcharov 
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CHAPTER 1 


Fundamental Concepts 

of Probability Theory. 

Direct Calculation 

of Probability in an Urn Model 


1.0. The theory of probability is the mathematical study of random phenomena. 
The concept of a random event (or simply event) is one of the principal concepts In 
probability theory. An event is the outcome of an experiment (or a trial). Six dots 
appearing on the top face of a die, the failure of a device during its service life, and 
a distortion in a message transmitted over a communication channel are all exam- 

les of events. Each event has an associated quantity which characterizes how 
ikely its occurrence is; this is called the probability of the event. 

There are several approaches to the concept of probability. The “classical” ap- 

roach is to calculate the number of favourable outcomes of a trial and divide it 
by the total number of possible outcomes [see formula (1.0.6) below]. The frequency 
or statistical approach is based on the concept of the frequency of an event in a long 
series of trials. The frequency of an event in a series of N trials is the ratio of the 
number of trials in which it occurs to the tota] number of trials. There are random 
events for which a stability of the frequencies is observed; with an increase in the num- 
ber NV of independent trials, the frequency of the event stabilizes, and tends to a 
certain constant quantity, which is called the probability of an event. 

The modern construction of probability theory is based on an axiomatic approach 
using the fundamental concepts of set theory. This approach to probability theory 
is known as the set-theoretical approach. 

Here are the fundamental concepts of set theory. 

A set is a collection of objects each of which is called an element of the set. A set 
of students who study at a given school, the set of natural numhers which do not 
exceed 100, a set of points on a plane lying within or on a circle with a unit radius 
and centre at the origin are all examples of sets. 

There are several ways of designating sets. It can be denoted either by one capi- 
tal letter or by the enumeration of its elements given in braces or by indicating (al- 
so in braces) a rule which associates an element with a set. For example, the set 17 
of natural numbers from 4 to 100 can be written 


M = {f, 2, ».., 100} = {iis an integer; 14 < i< 100}. 


The set C of points on a plane which lie within or on a circle with centre at the ori- 
gin can be written in the form C = {z? + y®?< R®}, where z and y are the Cartesiar 
coordinates of the point and A is the radius of the circle. 

Depending on how many elements it has, a set may be finite or infinite. The set 
AM = {1, 2,..., 100} is finite and contains 100 elements (in a particular case a finite- 
set can consist of only one element). The set of all natural numbers V = {4, 2 
n, ...} is infinite; the set of even numbers No={2, 4, ..., 2n, ...} is also infinite. An 
infinite set is said to be countable if all of its terms can be enumerated (both of the. 


infinite sets V and N’. given above are countable). The set C of points withi 
a circle of radius R > 0 points within or on 


C= {2° -+ y< R} (1.0.4): 


is infinite and uncountable (its elements cannot be enumerated). 

Two sets A and B coincide (or are equivalent) if they consist of the same ele- 
— a coincidence of sets is expressed thus: A = B). For example, the set of 
roots Of the equation z* — 52 -+ 4 = 0 coinci rj : 
a -\ ides with the set {1, 4} (and also 

The notation a € A means that an object a is an element of a 


words, a belongs io A. The notation a € A means that an object 
of a set A, 


set A; or, in other 
ais not an element 
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An empty setis a set with no elements [t is designated gi LUxample the set of 
points on a plane whose coordinates (t y) satisfy the inequality 2? + y*<2 —1f 1s 
anempty set {z?+ y's —1} = @ All emp sets are equivalent 

A set B is said to he 4 subset of a set A if all the elements of B also belong to A. 
The notation 1s # << A for A 2B) Examples {1, 2, ,100}c fi, 2, ., 1000}, 
{i, 2 , 1003}c {ff 2 400) fz? + yee i} S [23 + yy? SS 2} 

An empty set is a subset of any set A = A 

We can use a geometrical mterpretatian ta depict the inclusion of sete the points 
on the plane are elements of the set (see Fig 101 where # 1s a subset of A), 





Fig 101 


The wrion (logical sum) cf the seta A and B isa set C = A+R which consists 
ol all the elementa of A and all those of 8 (including those which beloig to both A 
and B} In short, a union of two sets 1s a collection of elements belonging to at 
feast one of them Kramples {4 2 10034-4450 44 200}; —{4 2 , 2O0}, 
iz, i0}+ fi 2 {000} ={1 2 1000} {22 tog t+og= 
i2 100} The union of tha two sets A and B is shown in Fig 1 0 2, the 
shaded area 15 A -+ &, 
We can simlarly deine a union of any number of sets Aj+4,+ +A,= 


Tt 
> Ay 18 a set consisting of all the elements which belong to at least one of 
i=i 
the seta 4,, , A, We can also consider a union of an infinite (countable) 


number of sets >) 4;=4,+4,+ t+4pt+  « Example {1, 2}+{2, 3}+ 


i= 
{3, ae tin, r—t}+  ={t, 2,3,  , 7 } 
The fntersection (logical product) of twosets A and @ is the set D = A B that 


consista of the elements which belong to both Aand # Examples {1 2 , 100} x 
{0 ol, 200} = {50, 5t 100} {i 2 100} {1 2, , 1000} = 
{, 2, «, 100}, {1.4 . , 400} a= @ An intersectionofl two sets A and B 


as shown in big 1 
We can similarly define the intersection of any number of sets ThasetA, A, .. 


Ti 
A, == if A, consists of all the elements which belong to allthesets A, A, .- 


A, simultaneously The defimtion can be extended to an infinite (countable) 


jan) 

oumber of sets lf A, 18 a set coneisting of elements belonging to afl the sets A,, 
As A, simultaneously 

Two sets 4 and # are said to be disjoint (nonintersecting) tf their intersection 
is anempt} set 4 B= @ 1e no element belongs to hoth A and B (Fig 10 4), 
Figure 105 illustrates several digyoml seta 

Asin the notation of an ordinary multiplication the sign is usally omitted. 

It 218 sufficient to have this elementary knowledge of set theory in order to use 
the set theoretical construction of probability theory 

Assume that an expetiment (tral) isconducted whose result is not known before- 
hand 1e ta accidental Let us consider the set 2 of all possible outcomes of the 
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experiment: each of its elements w € 2 (each outcome) is known as an elementary 
event and the whole set Q as the space of elementary events or the sample space. Any 
subset of the set Q is known as an event (or random event); and any event A is a sub- 
set of the set Q, viz. A & 2. 

Example: an experiment involves tossing a die; the space of elementary events 
Q = {4, 2, 3, 4, 5, 6}; an event A is an even score; A = {2, 4, 6}; A c& Q. In partic- 
ular, we can consider the event Q (since every set is a subset of itself); it is said 
to be a certain event (it must occur in every experiment). We cau add the empty set 
@ to the whole space Q of elementary events; this set is also an event and is said 
to'be an impossible event (it cannot occur as a result of an experiment). An example 


BHOVOCE 


Fig. 1.0.3 Fig. 1.0.4 Fig. 1.0.5 


of a certain event: {a score not exceeding 6 when a die is tossed}; an example of an 
impossible event: {a score of 7 dots on a face of a die}. 

Note that there are different ways of defining an elementary event in the same 
experiment; say, in a random throw of a point on a plane, the position of the point 
can be defined both by a pair of Cartesian coordinates (x, y) and by a pair of polar 
coordinates (p, @). 

Two mutually disjoint events A and B (such that AB = @) are said to he in- 
compatible; the occurrence of one precludes the occurrence of the other. Several 
events Ay, Ao, ..., A, aresaid to be pairwise incompatible (or simply incompatible), 
or two-by-two mutually exclusive events, if the occurrence of one of them precludes 
the occurrence of each of the others. 


ql 
We say that several events A,,A,,..., A, form acomplete group if A;= Q, Le. 


; ; ; ix1 

if their sum is a certain event (in other words, if at least one of them is certain to 
occur as a result of an experiment). Example: an experiment consists in tossing a 
die, the events A = {41, 2}, B = {2,3,4}, and C = {4,5,6} form a complete 
group; A a ae + C= {1, 2, 3, 4, 5, 6}=Q. 

We now introduce axioms of probability theory. Assume that every event is 
associated with a number called its probability. The probability of an event A 
Is designated as P (A)*). We require that the probabilities of the events should 
satisfy the following axioms. 


I, The probability of an event A falls between zero and unity 


O< P(A)<1. (1.0.2) 
IY. Probability addition rule: if A and B are mutually exclusive, then 
P(A + B) = P(A) + P (B). (1.0.3) 


Axiom (1.0.3) can be immediately generalized to any finite number of events: 
1, 49, +++, Ap are mutually exclusive events, then 


nm n 
P( 2 4i)= 2 P (Ad (1.0.4) 
= i=i 


*) If an event (a set) is denoted b ipti 
s y a verbal description of its properties. or 
by a formula of type (1.0.4), or by an enumeration of the elements of or rather 


than by a letter, we do not use parenth but u . 
probability, e.g. P {22 -- y< a eses but use braces when designating the 
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IEL Probability addition rule for an infinite sequence ofevents ff A, A, A, 
are mutually exclusive events then 
P(S 4)= ¥ P40 (1 05) 
i-- | i—| 


The atioms of probability theory can be used to calculate the probability of any 
events ithe subsets of § from the probabilities of the elementary events {if there is a 
finite or countable number of them’ It 13 not necessary to consider here the ways 
of determining the probability of the elementary events In practice they are found 
e1tl er from a consideration of the symmetry of the etperiment (for a symmetric die, 
for instance it 1s natural te assume the appearance of each face te be equipes*ible) 
or on the bawys of experimental data (frequencies} 

If the pocsible outcomes of an experrment have symmetry then the probabil 
tres cin be directly calculated from the so called urn model (model ef events) This 
technique 1s baced on the assumption that the elementary events are equipossible 
Several eventsA, Ay A, are said to be equipossible if they have the same prob- 
ability by virtue of the symmetry of the conditions of the experiment relative te 
those events P{d4,) P(A.) = — FP {A, 

If in an experiment we can represent the sample space f2 ag a complete group 
of disjoint and equipossible events o, a, w, then the events are called cases 
(chances) and the expeliment 2s said to reduce to the urn model 
, A case wo; 18 eaid to be favourable to an event A if it rs an element of the set 

wo, F A 

Since the cases m, W. w, forma complete gioup of events it follows that 


ir 
> i= C 
i= 1 


mince the elementary events w, @, fa, are incompatible it follows from 
the probability addition rule, that 


P{ >) o)—P (= >’ Pio) =1, 
i=1 i=ji 


Since the elementary events @, a; , W, are equipossible thew probability 
is the same and is equal to i/n 


P (a) = P{o,) =... = P (w,) = ifn 


This formula yields a so-called efassical formula for the probability of an event 
if an expertment reduces to an urn model then the probability of event A in that expe- 
riment can be caleulated by the formula 


P, (A) = ma/n, (1 06} 


where m, 18 the numher of cases favourable to the event A and » 13 the total num- 
her of cases 

Formula (106) which was once accepted as the definition of probability ts 
now with the modern atiomatic approach a corollary of the probability addition 
rule 

Let us consider an example Three white and four blach balls are thoroughly 
Stitred in an urn anda ballis drawn at random Construct the sample space for this 
experiment and find the probability of the event A = {a white hall is drawn} 


Vee now label the balls 1 to 7 nchieive the frst three balls ara white and the last 
four are black Hence 


QO = {1,2,3,4,5,6 7}, A= {1,2 3} 


Since the experimental conditions are symmetrie with reepect to all the halls {a 
hall is drawn at random} the elementary events are equipossible Since they are 
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incompatible and form a complete group, the probability of event A can be found 
by formula (4.0.6): P (A) = mg/n = 3/7 _— 

When the experiment is symmetric with respect to the possibility of outcomes, 
formula (1.0.6) makes it possible to calculate the probabilities of events directly 
from the conditions of the experiment. a 

A “geometrical” approach to the calculation of the probabilities of events is a 
natural generalization and extension of a direct calculation of probabilities in the 
urn model. It is employed when the sample space 2 includes an uncountable set of 
elementary events w € Q and by symmetry none of them is more likely than the 





Fig. 1.6.6 Fig. 1.0.7 Fig. 1.0.8 


others as concerns, the possibility of occurrence*). Assume that the sample space 
Q is a domain on a plane (Fig. 1.0.6) and that the elementary events are points 
within the domain. If the experiment has a symmetry of possible outcomes (say, 
a “point” object is thrown at random in the interior of the domain), then all the 
elementary events are “equal in rights” and it is natural fo assume that the proba- 
bilities that the elementary event wil} fall in domains I and II of the same size 
S are equal and the probability of any event A < Q is equal to the ratio of the area 
S, of domain A to the area of the whole domain Q: 


P (A) = S4/So. (1.0.7) 


Formula (1.0.7) isa generalization of the classical formula (1.0.6) to an uncount- 
able set of elementary events. The symmetry of the experimental conditions with 
respect to its elementary outcomes w is usually formulated using the words “at 
random”. In essence this is equivalent to the random choice ofa ball in an urn (see 
above). In texthooks the probabilities calculated by this technique are often 
called “geometrical probabilities”. . 

Assume, for instance, that two points with abscissas x and y are put at random 
on the interval from 0 to 2 (Fig. 1.0.7). Find the probability that the distance L 
between them is less than unity. The elementary event w is characterized by a pair 
of coordinates (z, y). The space of elementary events is a square with side 2 on the 
z, y plane (Fig. 1.0.8). We then have L = | y — z] and so theevent A = {ly— 
x | < 41} is associated with the domain A which is hatched in Fig. 1.0.8. 


P(A)=P {ly—2z| <1} = Sy/Sq = 3/4. 


If the space of elementary events is not plane but three-dimensional, then we 
_ replace _ areas S “A and So 7 7 (1.0.7) by the volumes VY, and Vo, 
: or a one-dimensional space, the lencths ZL, an O l - 
ments of a atraicht tne y g 4 and Lp of the corresponding seg 


pe errr Pa a ase ree 


“) We do not say that the elementary events o are 


ascertain in Chapter 5 that the probability of each of Mt, ae tppecson - we shall 


em is equal to zero. 
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Problems and laxercises 


1.4. Find out whether the events indicated in each example form 


a complete group of events for the given experiment (answer yes or 
no) 


(t} An experiment involves tossing a coin, the events are 
A, = {heads}, A, = {tails} 
(2) An expernment involves tossing two coins, the events are 
B, = {two heads}, 2, = {two tails} 
(5} An experiment involves throwing two dice, the events are 
C, == {each die comes up 5} 
Cs {none of the dice comes up 5}, 
C, = {one die comes up 6 and the other does not}. 


(4) Two signals are sent over a communication channel, the events 
are 


D, = {at least one signal is not distorted}, 
D, = {at least one signal 18 distorted}, 


(5) Three messages are sent over a communication channel, the events 
are 


&, = {the three messages are transmitted without an error}, 
E, = {the three messages are transmitted with errors}, 
iy = 


{two messages are transmitted with errers and one with- 
out an error} 


Answer. (1) yes, (2) no, (3) yes, (4) yes, (5) no 


Regarding each group of events say whether they are mcom- 
patible in the given experiment (yes, no) 


(1) An experiment involves tossing a coin the events are 
A, = {a head}, A, = {a tail}, 
(2) An experiment involves tossing two coins, the events are 
&, = {fhe Orst com comes up heads}, 


B, = {the second coin comes up heads}. 
(3) Two shots are fired at a target, the events are 


Cy = {no hits}, Cy = {one bit}, C, = {two hits} 
(4) The same as above, the events are 


== fonelit}, D, = fone miss}, 
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(5) Two cards are selected from a pack; the events are 
E, = {both cards are from black suits}; 
E, = {there is a queen of clubs among the selected cards}; 
E, = {there is an ace of spades among the selected cards}. 
(6) Three messages are transmitted by radio; the events are 
F, = {there is an error in the first message}; 
F, = {there is an error in the second message}; 


F, = {the first message contains an error and the second 
does not}. 


Answer. (1) yes, (2) no, (3) yes, (4) no, (5) no, (6) no. 
1.3. Regarding each group of events say whether they are equipos- 
sible in the given experiment (answer yes or no). 


(1) An experiment involves tossing a coin; the events are 
A, = {it comes up heads}; A, = {it comes up tails}. 


(2) An experiment involves tossing an unfair (concave) coin; the events 
are aS above, A, and Ag. 


(3) A shot is fired at a target; the events are 
B, = {a hit}; 8B, = {a miss}. 
(4) An experiment involves tossing two coins; the events are 


C, = {two heads}; C, = {two tails}; C; = {one head and 
one tail}. 


(5) A card is selected from a pack at random; the events are 
D, = {a heart}; D, = {a diamond}; 
Dz, = {a club}; D, = {a spade}. 


(6) An experiment involves throwing a die; the events are 


£, = {the score is no less than 3}; 
E, = {the score is no more than 3} 


(7) Three messages of the same length are sent over a communication 
channel under the same conditions; the events are 


{an error in the first message}; 
2 = {an error in the second message}; 
{an error in the third message}. 


Answer. (1) y : 
a0, (7 de, ) yes, (2) no, (3) no in a general case, (4) no, (5) yes, (6) 


16 Apolted Problems tn Probability Theory 


14 Regarding erth of the following group of events sty whether 
the; form a complete group whether they are incompatible, whether 
the, are equipossible, or whether they form a group of cases 

(1) An experiment involves tossing a (fair) colin, the events are 


A, = {it comes up heads}, A, = {it comes up tatls} 
(2) An experiment involves tossing two coins, the events are 
B, = {two heads}, B, = {two tails}, 
B, = {one head and one tail} 


{3} An experiment involves throwing a die the events are 
C,= (or2} C, = {2 or 3}, Cy = {8 or 4}, 
C,= {4 or 5}, C, == (5 or Gh. 

(4) One card 18 selected from a pack of 36 at random, the events are 
D, = {an ace} Dg = {a hing} Dy = {a queen}, 
D,={akhnave} 0, = {a ten} Dg = {a nine}, 

D, = {an eight}, Dg = {a seven}, Dg = fa sry}. 

(5) A shot is fired at a target, the events are 

£, = {a int}, Fy = {a ms3}. 
{6} Three messages of the same length are sent under the same ¢on- 
ditions the events are 
F, = (the first message 1s distorted}, 
F, = {the second message ts distorted} 
F, == {the third message 1s distorted} 


(7) Two devices are operated for a time t, the events are 
Gy = {none of the devices failed} 
f&, = fone device fatled and the other did not}, 
G, = {both devices failed}. 


Answer (1) yes yes yes, yes (2) yes yes no,no (3) yes no, yes, no, 
(4) yes, yes, yes, yes, (5) yes, yes, no, ne, (6) no no, yes, no, 
(7} yes, yes, mo, ne 

15 A coin is tossed until two heads or two tails are obtained in 
succession Gonstruct the sample space for the experiment and isolate 
the subset corresponding to the event A = {no more than three tossings 
will be necessary} Can the probabbty of the event be found as the ra 
tio of thea number of elementary events favourable to A to the total 
number of elementary events and if not why? 

Solution. The elementary events which form the set Q {the heads are 
denpted by the letter bh’ and the tails by “t") are O,= {h hh, a, = 
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= {h, t, t}, o, = {t, h, bh}; o,; = {h, t, bh, b}, = 
i nae ie ey eines tt events is infinite but countable: 
ee {04, Wo, Ws, ...-}. The use of elementary events favourable 

is A = {Q,, We, M3, Was. 

aa atest e find here the probability of the event A as the ratio 
of the number of elementary events favourable to A to the total number 
of elementary events since the elementary events @1, 2g, @3, .-.- are 
not equipossible: each pair is less probable than its predecassor [see 
problem 2.18 to find P (A)I. | 

1.6. A polyhedron with & faces (k > 3) labelled 1,2, ..., kis thrown 
onto a plane at random and it falls one or another face down. Construct 
the sample space for the experiment and isolate the subset correspond- 
ing to the event A = {the polyhedron falls the face not exceeding the 
number k/2 down}. 

Solution. The space Q consists of k elementary events: Q = {1,2,..., 
k}, where the numbers correspond to the number of faces. The 
subset A consists of elementary eventsA = {1, 2, ..., [k/2]}, where 
[k/2} is an integral part of 4/2. 

{.7. Under the conditions of the preceding problem, the polyhedron 
is regular; the possible number of faces are k = 4 (a tetrahedron); k = 6 
(a cube); & = 8 (an octahedron); & = 12 (a dodecahedron); & = 20 
(an icosahedron). Find the probability of the event A for each polyhedron. 

Solution. For a regular (Symmetric) polyhedron the appearance of 
each face is equipossible and, therefore, we can calculate P (A) by 
‘formula (1.0.6). Since the number of faces in each regular polyhedron 
is even, it follows that [k/2] = k/2 and so for each of them P (A) = 1/2. 

1.8. There are a white and b black balls in an urn. A ball is drawn from 
the urn at random. Find the probability that the ball is white. 

Answer. a/(a + b). 

1.9. There are a white and b black balls in an urn. A ball is drawn 
from the urn and put aside. The ball is white. Then one more ball is 
drawn. Find the probability that the ball is also white. 

Answer. (a — l)/(a + 6b — 1). 

1.10. There are a white and b black balls in an urn. A ball is drawn 
from the urn and put aside without noticing its colour. Then one more 
ball is drawn. It is white. Find the probability that the first ball, which 
was put aside, is also white. 

Answer. (a — 1)/(a + 6 — 1). 

1.11. An urn contains a white and b black balls. All the balls except 


for one ball are drawn from it. Find the probability that the last ball 
remaining in the urn is white. 


Answer. a/(a + b). 
1.12. An urn contains @ white and 8} black balls. All the balls 


are drawn from it in succession. Find the probability that the second 
drawn ball is white. 


Answer. a/(a + 6). 

1.13. There are a white and b black balls in an urn (a > 2). Two balls _. 
are drawn together. Find the probability that both balls are whit-’ 
2—-0575 
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Solution An event A = {two white balls} The total number of 
outcomes 


n= Cli. = (@ + &) (a -+ b — 1)/(1 2); 


where =o is the number cf combinations of A elements 


taken m ata time 
The number of invourable onitomes 


m, = Ci = ala — 1)(1 2) 
The probability of event A 
P (A) = mgin = (a — 1f/[(a + B) (a + Bb — 1p) 


114 There are a white and & black balls m an urn (a = 2 & > 3) 
Five balls are drawn together Find the probability p that two of them 
are white and three are black 

Solution The total number of cases 


n= (8 pe er Mor 8) feb — 2) fa +b — 3} (ab 4) 
vate 12345 


The number of faxourable outcomes 


_ pts a4a—i) bib—Y ED 
m=Cle=— Ts Gag 
_. Te 10@ (a — t) 6 (6—1) (6-3) 
pen +8) at b— 1 @+b—2 (e+ b— 3) a oF) 





115 A batch consists of # articles ¢ of which are faulty A total of r 
articles are taken from the batch for inspection Find the probability p 
that exactly s of the selected articles are faulty 

Answer p=CiCh_V/C} 

116 A die 1s thrown once Find the probabilities of the following 
events 


A = {the score 1s even}, 
& = {the score is no less than 5} 
C = {the score 1s no more than 5} 


Answer P (A) = 1/2, P (B) = 1/3, P (C) = 5/6 

1 17. There are a white and 6 black balls in an urn (a >> 2, & >> 2) 
ie ° balls ara drawn at once Which of the following events is more 
ikely 


A = {the balls are of the same colour}, 


B= {the halls are different in colour}? 
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Solution. 
CEC, a (a—t)+b(b—4) 


P(A)= C2, = (a-+b) (apb—1) ’ 
CYC; 2ab 
C2, ere) 


Comparing the numerators of the fractions, we find that 
P(A)<(P(B) for a(a—1)+ b (b — 1) < 2ab, 
i.e. (a — DF <a J; 
P (A) = P (B) for (@— db =a + 8, 
P (A) > P (B) for (a — bP? >a + 6. 


4.18. A box contains nm enumerated articles. All the articles are taken 
out one by one at random. Find the probability that the numbers of 
the selected balls are successive: 1, 2, ..., 7. 

Answer. 4/n! 

4.49. The same box, as in the preceding problem, but each article 
is drawn and its number is written down, after which it is replaced and 
the articles are stirred. Find the probability that a natural sequence 
of numbers will be written: 1, 2, ..., n. 

Answer. 4/n”. 

4.20. Eighteen teams participate in a basketball championship, out 
of which two groups, each consisting of 9 teams, are formed at random. 


Five of the teams are first class. Find the probabilities of the following 
events: 


A = {all the first class teams get into the same group}; 


B = {two first class teams get into one group and three into the other}. 
Answer. 


2CzCs 1 C2Cis + C2CS 12, 
PA=—g =a P@)=— “a =i 


1.21. A certain Petrov buys a bingo ticket and marks 6 of the 49 num- 
bers. Then the six winning numbers, out of the 49, are announced, 
Find the probabilities of the following events: 


Az = {he guessed 3 out of 6 winning numbers}; 
A, = {he guessed 4 out of 6 winning numbers}; 
A, = {he guessed 5 out of 6 winning numbers}; 
A, = {he guessed all the winning numbers}. 


Solution. The problem is equivalent to drawing 6 balls from a 
in which there are 6 white balls (winning numbers) and 49 — 6 = 43 


oe 
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black balls {not winning) 





P(A,) = ite ww 001765, P(A} =~ ts sy 0 000969, 
P (As) = EC sx 0 00001845, P (Aq) = Gyr © 0 715-10" 


1.22. Nine cards are labelled 0, 1, 2, 3, 4, 5, 6, 7, 8 Two cards are 
drawn at random and put on a table mm a successive order, and then 
the resulting number 1s read, say, 07 (seven), 14 (fourteen) and so on 
Find the probability that the number 15 even 

Solution. The evenness of a number 18 defined by its last digit which 
must be even (zero 1s also an even number) The required probability 
1s the probahility that one of the numbers 0, 2, 4, 6, 8 will be the second 
to appear, ie 5/9 

123 Five cards are labelled t, 2, 3, 4, 5 Two cards are drawn one 
after another Find the probability that the number on the second card 
is larger than that on the first 

Solution. The experiment has two possible outcomes 


A = {the second number is larger than the first}, 
B = {the second number 18 smaller than the first}. 


Since the conditions of the experiment are symmetric with respect to A 
and #, we have P (A) = P (B) = 1/2 

1 24. A box contains articles of the same type manufactured at dif- 
ferent factories, a of them are manufactured at factory I, 5 at factory 
It and ¢ at factory III All the articles are taken from the box one after 
another and the factories at which they were manufactured are written 
down Find the probabrlity that an article manufactured at factory 
I will appear before that manufactured at factory IT 

eolution it is irrelevant whether any of the articles are from fac- 
tory II] The probability we seek is the probability that an article man- 
ufactured at factory I 19 the first to be drawn, where a articles are 
from factory I and 8 articles are from factory II, 1e, a/(a - 8) 

125 There are two boxes contamming standard elements for replace- 
ment ‘The first box contains a sound elements and d faulty ones, and 
the second box contains ¢c sound and d faulty elements One element 1s 
drawn at random from each box Find the probability that both ele- 
ments are sound 

Solution. Each element from the first box can be combined with each 
element from the second box, the number of cases n = (a2 + b} (e + d} 
The number of favourable cases m = ac and the probability of the 
event 18 ac/[(a -+ 8) (e +- d}] 

1.26. Under the conditions of problem 1 25 find the probability that 
the two elements are different in quality 

Answer. (ad + dc)/[fa + 8) fe + a] 

1.27, Under the same conditions find the probability that 
both elements are faulty 

Answer. bd/[(a -+ 5) (¢ + a] 
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4.28. A box contains k articles of the same type labelled Wi Bek aes 
A total of J articles are taken from the box in succession at random, the 
number of each article taken out is written down and the article is 
replaced. Find the probability p that all the numbers written down are 
different. 

Solution. The number of cases n = k'. The number of favourable 
cases is equal to the number of arrangements of & elements taken / at 
a time, i.e. m= k(k—1)... (k—1+ 1). The probability of the 
event 


om _k(k—-1)...(e—-14+-) 
a a ¥ — kl (k—1)! 


1.29. A child who cannot read plays with blocks labelled with the 
letters of the alphabet. He takes five blocks from which the word “table” 
is formed. Then he scatters them and puts them side by side in an 
arbitrary fashion. Find the probability p that he will again form the 
same word. 

Answer. p = 41/5! = 4/120. 

1.30. The same question for the word “papaya”, a tropical Amer- 
ican tree. 

Solution. The number of outcomes n = 6!; however the number of 
favourable outcomes is now not unity as in problem 1.29 but m = 312! 
since the repeating letters “a” and “p” can be put in any order: p = 
3121/6! = 1/60. 

1.31. Several cards are selected from a complete pack of 52 cards. 
How many cards must we select to state, with a probability greater 
than 0.50, that cards of the same suit will be among them? 

Solution. We designate A = {the presence of at least two cards of 
the same suit among the selected k& cards}. 

For k = 2 we have n= C?,, mg = C?,-4; P (A) = 0.235 < 0.50. 

For k= 3 we have n= C%,, my = C°, -4-+ C},C},-4; P(A) = 
0.602 > 0.50. | 

Thus we have to select & > 3 cards. 

1.32. N people take seats at random at a round table (V > 2). Find 
the probability p that two fixed people A and B will sit side-by-side. 

Solution. The total number of cases n = N! Let us calculate the 
number of favourable cases m. There are two ways of seating two people 
A and B side-by-side and the other people can be seated in (N — 2)! 
ways; then m = 2N (N — 2)! and p = 2N (N — 2)\/N! = 2/(N — 1). 
There is a simpler way of solving the problem: let A sit where he pleases. 
Now there are NV — 1 seats B can take, two of which are favourable: 
hence p = 2/(N — 1). 


1.38. The same problem for a rectangular table with N people sit- 
ting arbitrarily along one side of the table. 

Solution. n= N!; the favourable cases divide into two groups: 
(1) A sits at an end; (2) A does not sit at an end. The number in the 
lirst m, = 2 (NV —2)}! and the number in the second Mm, = 2(N — 2)x 
(NV — 2)1; p = (m, + m,)/in = 2(N — 1) (N — 2)/N! = 2/N. 
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134 There are M operators and V enumerated devices which they 
can service Each operator chooses a device at random and with equal 
probability but under the condition that none of the devices can be 
serviced by more than ane operator Find the probability that the de- 
vices labelled 4 2 Af will be chosen 

Solution The number of ways of distributing Af operators over N 
devices 13 equal to the number of permutations of V elements taken Af 
atatime viz mn = N {N ~1) (V — +1) By the hypothesis 
all these ways are equipossible 1¢ they form a group of cases The 
number of favourable cases (when only the first AY devices are serviced) 
is m == Wl Hence the required probability 


ee | 
Po NEN 4) (NW —AF-F 1) ™ on 


i135 There are A standard elements for replacement in a box among 
which KX, elements are of the ist type K, elements of the ith 


Tit 
type A, elements are of the mth type 2 Ks = K k elements 


= 
are taken from the box at random Find the probabtlity that there will 
be &, elements of the ist type ie, elements of the z:th type » Bm 
elements of the mih type among them 
Solution The total number of cases nis equal to the number of ways 
in which & elements can be selected from K elements m = C% The 
number of favourable cases 


i hk 
m-CACr, Cx = II Ch 
since &, elements of the ist type can be chosen in CH ways ke, ele 


ments of the mth type can be chosen in Cx" Wats and various com 
binations of them can be formed The required probability 


TY he pak 
a ll, Ox Cx 


{ 26 A local post office is to send four telegrams there are four com 
munication channels in all The telegrams are distributed at random 
over the communication channels each telegram 18 sent over any chan 
nel with equal probability Find the probability of the event A = 
{three telegrams are sent over one channel one telegram over ano 
ther channel and two channels remain empty} 

Solution The total number of cases n ~ 42 The number of ways to 
choose a channel over which three telegrams are sent C, — 4 the num 
ber of waysto choose a channel over which one telegram is sent C$ = 3 
The number of ways to choose three telegrams out of four to send them 
ayer one channel Cj = 4 The total number of favourable cases mg = 


P (A) = m,in = 4 3 4/44 — 3/46 
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1.37. M telegrams are distributed at random over NV communica- 
tion channels (V > M). Find the probability of an event 
A = {no more than one telegram will be sent over each channel}. 
Solution. The total number of cases is N%. The number of ways to 
choose Jf channels out of N in order to send one telegram over each 


of them is CY’. The number of ways to choose one telegram out of M 
and to send it over the first of the channels is C}, = M. The number of 
ways to choose the second telegram out of the remaining M — 1 is 
Ch, = M—41, and so on. The total number of favourable cases 


m, = M(M—i1)...4=Mt!. 
P (A) = CN-MIN™, 


1.38*. A local post office is to send M7 talegrams and to distribute 
them at random over NV communication channels. The channels are 
enumerated. Find the probability that exactly 4, telegrams will be 
sent over the 1st channel, &, telegrams over the 2nd channel, and so 


N 
on, ky telegrams over the Nth channel, with >) k; = M. 


i==l 
| Solution. The number of cases n=N™. Let us find the number of 
favourable cases m. T’he number of ways to choose k, telegrams out of M is 


h 
Cit J the number of ways to choose k, telegrams out of theremaining M—k, 
. isCyz-n,, and so on. The number of ways to choose ky telegrams out of 


h 
M—(ky-+...-+hys)=ky is C3¥=41. These numbers must be mul- 
tiplied together. 


— pkipke Rnay 
m=CnCyr-h,..- Chi-(ait...tky_,)* 4 


— MM! (Mh)! [M—(ky-bke-+...-tkeyo)]! 
KL (Af —hy)! kel [MI — (Ue, the)! OC O”~*~*~*:*CqESC~™S 

ae AT! Mm. 

~Kylkgl...knyl ~~ ON? 


N 
P(A) =m/n = M1/ (NM iT Ie;\) . 
i=1 


nonce Under the conditions of problem 1.37 find the probability 
— no telegrams will be sent over J, of N channels, one telegram will 

e sent over /, channels, and so on; and all Jf telegrams will be sent 
over Z,, channels: 


lg + 


i Qt eee tly = NS 0-2+4-4+...4+ M1, = M. 


Fhe The total number of cases is n = N™. To find the number 
: pashan cases m, we must multiply the number of ways in which 
e channels can be chosen by the number of ways in which the tele- 
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erams can be chosen The number of ways to choose the channels 1s 
MM 
Niji lel y= NUL] dy! 


Let us find the number of ways in which the telegrams can be chosen 
They fall into a number of groups the muitial group (0 telegrams) is 
empty, the first group contains 2, telegrams in eeneral Ath group con 
tains ki, telegrams (k = 1, 2 Af) The number of ways to choose 
the groups of telegrams 15 


BM) Mt 
(1 2)! (24)! (32,)! Ming Af 
i}! (2ég)! (ae, (Ming) [T Gets) 
h—t 
Let us now find the number of ways to choose the telegrams from 


the Ath group so that & telegrams are sent over each channel This num 
ber of ways 1s 


(1 39 4) 


(Ala)\/ (ktkt Al) == (ed,)1/ (AN) 


fn times 


and the number of ways to choose all the telegrams for all the groups 
is equal to the product of these numbers for different A 


AI 


kts )I 
i ant (1 39 2) 


Multiplying (1 39 1) and (4 39 2), we get the number of ways in which 
the telegrams can be chosen 


M 
ky)! 
Mt i ee) Atl 


rr rrr rr 
Hoa FL aoe Ey cays 
Az 1 f==1 A=1 


Multiplying this number by the number of ways in which the channel 
can be chosen we find the number of favourable cases 


NI. ol 
a a 
i] ijt H {kl % 
a Koad 
fence the probabrlity of the event we are interested in 


P(A) =i (1 39 3) 
nN ypu [7 an 
ij 


Ee 
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4.40. There is a point image of an object // on a circular radar screen 
(Fig. 1.40) which is positioned at random in the circle, no domain with- 
in the circle being more probable (the image of the object is thrown at 
random” onto the screen). We consider an event A consisting In the dis- 
tance p from the point M to the centre of the screen being smaller than 
r/2, ie. A = {9 <r/2}. Find the probability 
of the event. 

Solution. The sample space 9 is the interior 
of the circle of radius r. The domain A is hatched 


in Fig. 1.40. 
S mr?/4 1 
P(A) =-3 ae TE 








1.41. We have a magnetic tape 200 m long 
with messages written on two tracks. The mes- Fig. 1.40 
sage on the first track is Z, = 30 m long and that 
on the other track is 7, = 50 m long; the location of the records is un- 
known. Because of a damage, we had to remove a section of the tape 
1, = 10 m long which begins 80 m from the start. Find the probabili- 
ties of the following events: 


A = {neither record is damaged}; 
B = {the first record is damaged and the second is not}; 


C = {the second record is damaged and the first is not}; 
D = {both records are damaged}. 


Solution. Since the location of neither record is known, we infer 
that each may begin anywhere as long as the whole record lies on the 
tape. We designate the abscissa of the beginning of the first record as z 
and that of the second record as y. The sample space is a rectangle of 
length L —l, = 170 m and of height LZ —1, = 150 m (Fig. 1.41). 
In the figure the different kinds of hatching designate the domains 
corresponding to damages to the first and second records, and the let- 
ters A, B, C, D designate the domains corresponding to the events A, 
B, C, D (every domain, except for D, consists of separate parts). 


So=170 x 150= 25500 m2, 
S,=00 x 60480 x 60+ 30 x 50+- 80 x 30 = 11 700 m?, 
S,;=40 x 60+ 40 x 30= 3600 m2, 
Sc=00 x 60+ 80 x 60= 7800 m2, 
Sp = 60 x 40= 2400 m?. 
P(A) =0.459, P(B)=0.141, 
P(C) =0.306, P(D)=0.094. 


1.42. Two signals t< 1/2 long 


: are transmitted by radio f 
interval (0, 1), e y 10 tor a time 


ach of them beginning at any moment of the interval 
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(0 1-—~ 7+) and with equal probability Li the signals overlap even par 
tially they both become distorted and cannot be recetved Find the 
probability that the signals will be received without distortion 


# 








f 
ve Tre first record 


if da maged 


Me 


ot 
The serond record 
is damaged 


SS 


Fig 1 4f 


Solution We denote the moment when the first signal begins by z 
and the moment when the second signal begins by y The sample space 
is shown in Fig 442 The hatched domains 
A correspond to the event 


Az=={the signals are not distorted} = 
={|z—y|>7} 
P(A} = S4/Sp = (1 —21}/ (1 —+)? 


143 There are two parallel telephone 
lines of length ? (Fig 1 43a) d<ol apart 
It 1s known that there is a break in each of 
them (the location of each break 1s un 
known) Find the probability thatthe distance 

Fig {42 R between the breaks is not larger than 
aeidctaxt VP 4 @) 

Solution. We denote the abscissa of the first break by z and that 
of the second by y AR = V | x—y|* +d The event we speak of 13 
A= {ljx—yP+@ <0} = {(\r~-yl|< Va? —@} The sample 
space is a square with side | Sg =? The domain A ts hatched in 

12 





§,=21y a@@—d—a?+d?, 


P(A) 2 Va—# S58 
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i Fig. 1.44a). 
a f unit leneth is broken into three parts z, y, 2 ( 
sas aaa oekaki that a triangle can be formed from the resulting 
parts. 





(a) 
Fig. 1.43 


ion. The elementary event w is characterized by two parame- 
enn aad y [since z = 1 oi (c + y)]. We depict the event by a point 
on the x, y plane (Fig. 1.44b). The conditions « > 0, y > 0, ery 1 
are imposed on the quantities x and y; the sample space is the interior 
of a right triangle with unit legs, i.e. Sg = 1/2. The condition A re- 
quiring that a triangle could be formed from the segments x, y, 1 — 


? 
y 


aS TEARS 
SG 


/ 
ue. = Z £ 


J ¢@) (6) (0) 
Fig. 1.44 





(x + y) reduces to the following two conditions: (1) the sum of any 
two sides is larger than the third side; (2) the difference between any 
two sides is smaller than the third side. This condition is associated 
with the triangular domain A (Fig. 144c) with area S, = (1/2) (1/4) = 
1/8; P (A) = S4/Sq = 1/4. 

1.45. Buffon's needle problem. A plane is ruled with parallel straight 
lines L distant from each other (Fig. 1.45a). A needle (a line segment) 
of length / < L is thrown at random on the plane. Find the probability 
that it will hit one of the lines. 

Solution. We characterize the outcome of th 


e experiment (the posi- 
tion of the needle) by 


two numbers: the abscissa x of the centre of the 
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needle with respect to the nearest line on the left and by the angle o 
the needle makes with the direction of the lines (Fig 1455) The fact 
that the needle 1s thrown on the plane at random means that all the 
values of x and p are equipossible We can evidently limit (without 
losing generality) the possible values of x to the interval from 0 to £/2 
and those of m to the interval from 0 to x/2, and consider the possibil 
ity of the needle hitting a Iine for only one of the lines (the nearest left 


WH 


holy 





Za 
(4) 2 


Fig 145 


(e) 


line} The sample space @ 1s a rectangle with sides L/2 and n/2 (Fig t 45c), 
Sg = En/4 The needle will hit the line :f the abscissa zx of its centre 
is smaller than (2/2) sin g, the event we are interested inis dA = {z << 
(7/2) sin @} The domain A 1s hatched m Fig 1 45c, its area 1s 
mje 
i 
Sy + sngdps—, 


th 


P(d)= Aas 


Remark This formula was obtained by Buffon in the 18th century and was re 
peatedly verified experimentally for which purpose the frequency of hits wag cal 
culated for a long serjes of throws The formula was even used to make an approxi 
mate calculation of the number 7 and satisfactory results were ohtaimed 


CHAPTER 2 


Algebra of Events. Rules for Adding 
and Multiplying Probabilities 


2.0. The theory of probability is based on indirect rather than direct methods of 
calculating probabilities when the probability of an event is expressed in terms of 
the probabilities of other related events. It is necessary, first of all, to know how to 
express an event in terms of other events using the so-called algebra of events. We 
now introduce the concepts of “a sum of events” and “a product of events” and oper- 
ations on them. Note that these concepts are only introduced for events which are 
subsets of the same space of elementary events Q . 

Since in our set-theoretical representation events are sets, the actions performed 
on them (addition and multiplication) are defined as those corresponding to set op- 
erations (see Chapter 1). _ 

Nevertheless, we shall repeat certain definitions and give them a geometric in- 
terpretation. We shall depict the space of elementary events as a rectangle and the 





Fig. 2.0.1 


Fig. 2.0.2 


events as parts of the rectangle (Fig. 2.0.1). The sum A + B of two events A and B 
is an event consisting in the occurrence of at least one of those events (the hatched 
domain in Fig. 2.0.1). The sum of two events is evidently a union (sum) of the re- 


TL 
spective sets. Similarly, the sum of several events Ay, Ag,,..., A, is the event >} A; = 


ii 
A,+A,+... + A, consisting in an occurrence of at least one of them. We 


CO 
can also form the union or sum of an infinite (countable) number of events: >) A;= 


ee oe eo ae ee = 


The product A-B of two events A and B is the eve 


"ae nt consisting in a simu] 
realization of the two events (the intersection of t g a taneous 


he sets, Fig. 2.0.2). The product 


% 

of several events A;, A>, ..., A, is an event I] 4; = A,A,... A, consisting in a si- 
i=} 

multaneous realization of all the events (an intersection of the respective sets). 


We can also multiply an infinite (countable) number of events: [{4 i= 4,A,... 
ere 


i=l 
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It follows from the definttions of a sum and a product of events that 
A+tA=A, AAH=A, 
A+t+Q=9, AQ=A, 
At+g=4, AQ=D 


Hi éAc#, thn A+R = 8B, A B= A 

The operations of addition and multiphcation of events have some of the 
properties of ordinary addition and multiplication 

1. Commutativity 


A+t+B=B+A4, ABSBA, 
2 Associativity 
(A+B) + C= AP(B+C), (ABC = A(BC). 
& Distrbutivity 


AtHh+ C)= AB -- AC, 
All these properties follow from the fact that events are seta (see Chapter 1) 


Sy 





Fig 20.3 Fig 204 Fig. 205 


An opposite” or complementary event of A 1s the event A of nonoccurrence of the 


event Ad A = {A has not occurred} A complementary event is represented in Fig 


203 The domain A 1s the complement of A with respect to the complete spate 2. 
It follows from the definition of a complementary event that 


(4=4 Deg, B= 


It as easy to verify (Fig 20 4) thatif B GA, then ASP It1s a3 easy to verify 
(Fig 20 5) the following properties of complementary events 
AFB=AB, AB=A+B 

The rules of the event algebra make 1t possible to combine various azmple events 
and form in that way other more complex events 

The probabilities of compound events can be calculated from the probahilities 
of simpler events, using two haste rules (addition and multiplication) of probability 
theory These rules are often called the fundamental theorems of probability theory, 
but in reality they are theorems only for the urn mode] and are introduced axiom 
atically for experiments which do not reduce to the urn model 

t The addition rule tor probabilities The probabslity of the sum of two mutually 
exclusive events is equal iothe sum of the probabtlitses of those events,ie A B= Gi, 


then 
P {A + B) = P (A) + F (B) (2 0 4) 


This rule was introduced aziomatically in Chapter 4 (2x10m JT) 
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The addition rule of probabilities can be easily generalized to an arbitrary num- 
ber n of incompatible events: if A;-A; = @& fori = j, then 


gr 71 

P( >} Ai)= >} P(Ad- (2.0.2) 
i=1 i= 

The addition rule can be as easily generalized to the case of an infinite (countable) 

number of events: if A;-A; = © for i =4], then 


P( 3) 4) = 3 PAD. (2.0.8) 
i=1 


i=1 


see axiom III in Chapter 1). a 
it follows from the addition rule that if Ay, 4, , .... Ap are disjoint events that 
form a complete group, then the sum of their probabilities is equal to unity, 1.@. if 


Tr 
> A;=Q, AyAj=@ for t¥], 
i=1 
then 
i 
>) P(A)=41. (2.0.4) 
i=1 


In particular, since two opposite events A and A are mutually exclusive and form 
a complete group, then the sum of their probabilities is equal to unity: 


P (A) + P (A) = 1. (2.0.5) 


To formulate the multiplication rule for probabilities, if is necessary to intro- 
duce the concept of conditional probability. The conditional probability of an event A, 
relative to the hypothesis that an event B occurs 
[designated as P (A | B)] is the probability of the 
event A calculated on the hypothesis that the event 
B has occurred. 

Advancing a hypothesis that the event B has 
occurred is equivalent to changing the conditions 
of the experiment, i.e. retaining only those elemen- 
tary events which are favourable to the event 
B and removing all the other events. It follows 
that instead of the space of elementary events Q we 
have a new space Q , corresponding to the event B 
(Fig. 2.0.6). The domain AB, which corresponds 
to the intersection of A and B, is favourable to Fig. 2.0.6 
the event A on the hypothesis that the event B 
is realized. 

2. The multiplication rule for probabilities. The probability of the product of two 


events A and B is equal to the probability of one of them (say, A) multiplied by the 
conditional probability of the other, provided that the first event has occurred: 





P (AB) == P (A) - P (B| A), (2.0.6) 
or, if we take B as the first event, 

P (AB) = P (B)-P (A | B). (2.0.7) 

pipers acl rule for probabilities can be generalized to an arbitrary number 


P (AjA 2 «. An) = P (Ay) + P (Ae | Ay) + P (Ag | AyAo) «-. P (Ay | AyAn «ss Ap). 
(2.0.8) 
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Formula (206) yields the following expression for a conditional probability 
P (B | A) = P (ABP (A), {2 0 9} 


be the conditional probability of ane event, on the Aupathests that the other event occurs, 
is equal to the probability of the product of the two events divided by the probabtttty 
of the event which fs assumed to be realized 

By analogy with formula {209} we can write 


P {4 ] 8) = P {ABP (3) (2 0 40} 


Two events A and B are said to be independent vf the occurrence of one of them 
does net affect the probability of the cecurrence of the other 


P{A | By = P (A), (2 0 it} 


or, which 1s the same thing, 


' For tuo independent eventa the multiplication rule for probabilities assumes 
the form 


P (AB) = P(A) P(B) (2 0 13} 


le the probability of the product of fo independent events is equal to the product of 
fhe probabilities af those events 
Several events are sald to be independent in their totality (or simply mdependent) 
uf the occurrence of any number of them does net affect the probabilities of the 
nner events For-several independent events the multiplication rule (2 0 8) assumes 
e form 


P (did, 1: Ay} =- P (Ay) Pp {A a} PF (A,}, (2 } 44) 


se the probability of the praduct of independent events is equal to the product of their 
Probabilities 

Several trials are said to be endependent if the prohabslity of the outcome of 
ach of them does not depend on the outcomes of the other trials 

The following theorem on a repetition of a trial ss a corollary of the addition 
and multiplication rules for probabilities Jf n independent trials are performed tn 
each of which an event A occurs with probability p then the probability of the event A 
occurring exactly m times in the given experiment is eqpressed by the formula 


Pron = CHP™(L — pye™, (2 0 15) 
or, designating f — p = gq, 
Pa n=Opypmgn™ (20 46} 


The probability of the event A occurmmng not less than m times in a seties of 
mn independent trials 1s expressed by the formula 


Th 
Rm,n= > Crpkg™, (20 17) 
kom 
or by the formula 
m—I 
Rm. n==t-— 2) Chphgta (2 0 18) 
A= 


From the two formulas (2 0 17} and (2 0 £8) we choose the one which contains 
4 smaller number of terms 
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Problems and Exercises 


2.1. Can the sum of two events A and B& coincide with their product? 

Answer. It can if the event A is equivalent to the event B (A < JB and 
Bc A). For example, if a message transmitted over a communication 
channel can only be distorted by a noise on the time interval occupied 
by the message and is surely distorted when there is a noise, then the 
events 


A = {the message is distorted}, 


B = {there is a noise on the time interval occupied by the message} 
are equivalent: A= 8B; A+B=A=B;,;AB=A=B. 





Fig. 2.2 Fig. 2.3 


2.2. Prove that if two events A and B are compatible, then 
P(A + B) = P (A) + P (SB) — P (AB). (2.2.4) 


Solution. Let us represent the event A + B as a sum of three incom- 


patible events: AB (A and not B); AB (B and not A) and AB (both A 
and B) (see Fig. 2.2): 


A+B=AB+AB-+ AB. 
We find the expressions of the events A and B: 
A = AB + AB; B = AB + AB. 
Using the addition rule for probabilities, we find: 
P (4 + B) = P (AB) + P (AB) + P (AB). (2.2.2) 
P (A) = P (AB) + P (AB), 
P (B) = P (AB) + P (AB). 
Adding the two last expressions together, we get 
P (4 ) + P (B) = P (AB) + P (AB) + 2P (AB). 
Subtracting (2.2.2) from this equation, we get 


P(A) +P (8B) =P (44+ B) +P (AB), 
3—0575 


34 Avplted Problems in Probabil ty Theory 


whence follows (224) From (2 2 1} 1% follows that 
P(A + B)<P (A) +P) 


aluays and the equality sign can be put only for incompatible events 
93 Write the expression for the probability of the sum of three joint 


events 
Solution From Fig 23 we obtain 


P(4 +8-+€) == P(A) + P (8) 4+ PC} — P (AS) — P (AC) 
— PRE) + PEAR) 
24 An experiment consists in tossing tuo coins The following events 

are considered 

A — {the first coun comes up heads} B = {the first coin comes up 
tails}, C — {the second coin comes up heads} 

D = {the second coin comes up tails} £ = {at least one head} 

F = {at least one taal} G— {one head and one tarl} 


fT = {no heads} A = {two heads} 
Determine the events ta which the following events are equivalent 
GjA+C (2)AC BOL ZG+E (oO) GE (6) BD T)E+EK 
Answer (A)A+C—-—EF (2) 10 -A QLF-G AGCGHLE-~E 
() GE —G (0) BD -H GE-~K-E£ 


25 Three messares are sent in succession ayer a communication 
channel each of which may either be sent correctly or be duastorted 
We consider the following events 

A; == {the tth message was sent correctly} 

A, — {the 7th message was distorted} (7 ~ 1 2 3) 
Express the following events as sums products and sums of products 
of tle events A; and A 


{ — {the three messages were sent correctly} 

#H— {the three messages were distorted} 

C = {at lewst one message was sent correctly} 

D = {at least one message was distorted} 

E = {not ess than two messages were sent correct}; } 


F = {not more than one message was sent correctly} 


G — {the first message sent correctly was the third in the 
sequence} 
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Answer. 
A=A,A,Aq, B= AAAs, oe a 
C = AyA,Ag+ AyAoAg+ AyAoAg + As4o43 + ArAgds + Aids + AAAs. 
D=A,A,Ay-+ AyAgAg + AyApAg + AyAoAgt+ AsAcAs 4. A,A,A3+ AyAcAs> 
E = AyA,Ag+ AyAoAs + As4,434+ ArAoAs: 


et - — 
— — — — — 


2.6. A group of four homogeneous objects is being tracked. Each of 
the objects can be either detected or not detected. We consider the fol- 
lowing events: 


A = {exactly one of the four objects is detected}; 

B = {at least one object is detected}; 

C = {not less than two objects are detected}; 
= {exactly two objects are detected}; 

E = {exactly three objects are detected}; 

F = {all four objects are detected}. 


Find what the following events consist in: (1) A + B; (2) AB; (3) 
B+ C; (4) BC; (5) D+ E+ F; (6) BF. Are the events BF and CF 
the same? Are the events BC and D the same? 

Answer. (1) 4 + B= 8;(2)AB=4A;(83)B+C=8;(4)BC=C; 
(5) D+E+ FF =C; (6) BF = F. The events BF and CF are the 
same; BC and D are not the same. 


2.7. Given below are experiments and the events that can occur in 
them. Indicate their complementary events. 

(1) Two messages are sent over a communication channel: an event 
A = {both messages are sent correctly}. 

(2) A ball is drawn from an urn which contains two white, three black 
and four red balls; an event B = {a white ball is drawn}. 

(3) Five messages are sent; an event C = {not less than three mes- 
sages are sent correctly}. 


(4) n shots are fired at a target; an event D = {at least one hit is 
registered}. 

(0) A preventive inspection of an instrument is made, the instru- 
ment consisting of & units, each of which can be either put in order at 
once 4 sent for repair. An event E = {none of the units is sent for 
repair}. 

(6) Two people play chess; an event F = {the whites win}. 

Auswer. (1) A = {at least one message is distorted}; (2) B = {a black 


or a red ball is drawn}; (3) C = {not more than two messages are sent 
Se 
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correctly} (4) D ~— {no hits are registered} (5) E = {at least one unit 


must be repaired} (6) F - {the blacks win or the game 1s drawn} 
28 Anevent #15 a special case of anevent A BOA 1e it fol 
lous from the occurrence of the event & that the event A has occurred 


Does it follow from & that A has occurred? 
Answer No it does not For instance an experiment may consist 
in Sending two messages anevent A = {at least one message 1s dis 


torted} and an event B = {both messages are distorted} HH an event B 
has occurred # — {less than two messages are distorted} it does not 
follow that neither of the messages 1s distorted (event A} On the con 
trary #8 follows from A (A & B) 

Figure 28 shows events A and B BGA and the complementary 
events A (vertical hatching) and # (horizontal hatching) It can be im 


mediately seen that d OB 
SEDGREESReReeee 29 If anevent & 1s a spectal case of an 
on event A (B <= A} are the events dependent? 

Answer They are dependent if P (A) =41 
since P (1/8) — 1 

210 Are the following events dependent 
(1) mutually disjoint events (2) events which 
form a complete group {3) equipossible 
events? 

Answer {1} Dependent since the occur 
rence of any of them turns into zero the 
probabilities of all the others happening 
{2} dependent since the nonoccurrence of all but one turns into unity 
the probabtlity of the last one (3} may be either dependent or inde 
pendent 

211 An experiment consists in a successive tossing of two coins 
We consider the following events 

A — {the first coin comes up heads} D = {at least one head comes 
up} £ — {at least one tail comes up} F — {the second coin comes up 
heads} Determine whether the following pairs of events are depen 
dent (1) A and E (2) Aand F @)Dandé (4)D and F Determine the 
conditional and unconditional probabilities of the events in each pair 

nswer 

(1) P(E) -— 3/4 P(# | A) — 1/2 the events are dependent 

(2) P(A} —- 1/2 P(A |F) = 1/2 the events are independent 

(3} P(D) = 3/4 P (D jE} — 2/3 the events are dependent 

(4) P(D)— 3/4 P(D}F)—1 the events are dependent 

2412 An urn contams a white and 6 black balls Two balls are drawa 


either simultaneously or one after another Find the probabrlity that 
both balls are white*) 





Fig 28 


*) Ths problem iike a number of other problems in th s"chapter can be aiso 
solved by a direct calculation of the number of cases The point here is to solve 
them by using the addition and mult pheation rules 
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Answer. By the multiplication rule for probabilities 


a—i 
at-b—1° 


P{both balls are white} = P{ww}= a3 


29.13. There are a white and } black balls in an urn. A ball is drawn, 
its colour is noted and the ball is replaced. Then one more ball is drawn. 
Find the probability that both drawn balls are white. 

Answer. [a/(a + b)]?. 

2.44. There are a white and b black balls in an urn. Two balls are 
drawn at once. Find the probability that the balls are different in colour. 

Solution. The event can be in two incompatible variants: {whb}{for 
{bw} by the addition and multiplication rules 


a b b a aad 
P{wh + bw} =T5 Gpe=t Toph apb—l ~ (+b) rot)’ 


2.15. The problem is the same as 2.14, but the balls are drawn one 
after another and the first ball is replaced. 

Answer. 2ab/(a + b)?. 

2.16. There are a white and b black balls in an urn. All the balls are 
drawn from the urn at random, one after another. Find the probability 
that a white ball will be the second in the sequence. 

Solution. We can find the probability of the event directly} (see 


problem 1.12). The same result can be obtained by the addition and 
multiplication rules, i.e. 


P {ww + bw} = —— Oct oe A : 2 : 


" a+b at+b—t4 a+b atb—i  a+bd* 7 
We) 


ss 
“2.17. There are a white, b black and c red balls in an urn. Three of 


them are drawn at random. Find the probability that at least two of 
them are of the same colour. 


Solution. To find the probability of an event consisting in at least two 


balls being the same colour, we pass to the complementary event A = 
{all the balls are different in colour}. 


P(A)=P {wbr-++ wrb-+- rbw-++ ...} 
— 6 combinat tons 
= a 5 c 


at+b+tec a-btce—1 latb-te—d ° 
Hence 


p A ee ee © 4 = _ 6abe 
(A) (4) = 4 (a--b--c) (a+-b+-e—1) (at+b+c—2) ° 





2.18. A coin is tossed until two heads or two tails 
Sion (see problem 1.5). Find the probability 
more than three tosses are needed}. 


appear in succes- 
of the event A = {not 
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* 95, Inabatch of NV articles V articles are faulty We take n articles 
from the batch for inspection Jf more than m articles in the batch are 
faulty, we reject the whole batch Find the probability that the batch 


will be rejected 
Sotution. The event A = {the batch 1s rejected} can be represented 


“5 4@ Sum 
A=Am+s1+ Amt: + ™ A,= >» Ay, 


where A, = {there are z faulty articles among those heing inspected} 
gi cn~t ve 

P(A) =EY, Pray OS 

¥ ism+i iW 


i ~n-i 
Cy ON 


226 A box contains homogeneous articles of different qualities, 
a articles are of the best quality, & articles are of the first quality and ec 
articles are of the second quality (2 > 4, b> 4 ¢ > 4} Four articles 
are taken simultaneously and at random from the hox without regard 
for their quality The following events are considered 


A = {at least one of the chosen articles 1s of the best quality}, 
B = {at least one of the chosen articles is of the second quality}. 


Find the probability of the event C = A+B 


Solution Passing to the complementary event C = {there 15 neither 
A nor B} = {all the articles are of the first quality}, we have 


whence 1t follows that P(C) = § — P(C) 

2.24. During one surveillance cycle of a radar unit, traching a target, 
the target 1s delected with probability p The detection of the target 
in each cycle ts independent of other cycles Find the probability that 
the target will be detected in nv cycles 

Answer. 1 — (1 — p)" 

2.28 There are m radar untrts, each of which detects a target during 
one surveillance cycle with probability p (independently of other cycles 
and other units) During time J each unit makes mn cycles Find the 
probability of the following events 


A = {the target is detected at least by one unit}, 
6 = {the target is detected by all units}. 

Answer, 
P(A4}=i-(d—py™, P(B=l11—-— (1 — pry 


«23, There is a group of & targets, each of which, independently of 
the other targets, can be detected by a radar unit with probabrlity Pp. 
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Each of m radar units tracks the targets independently of other units. 
Find the probability that not all the targets in the group will be de- 
tected. _ 

Solution. We pass to a complementary event A = {all the targets 
will be detected}: 


pP(dé@)=4—G—py"r; P(4)=1—[t— (4 —p)"l. 


9.30. A total of & workers take part in succession in the manufacture 
of an article: when an article is transferred to the next worker, its 
quality is not inspected. The first worker may spoil the article with 
probability p,, the second worker with probability p,, and so on. Find 
the probability that a faulty article will be manufactured. 

Answer. 


k 
Lee I (1 — pi). 


2.34. In a certain lottery 7 tickets were sold, / of which were winning 
tickets. A certain Petrov buys & tickets. Find the probability that he 
will receive at least one prize. 

Answer. 


{— n—i n--l—{ n—i—k-+]l oe (1— 1)! (n—k)! 


a 


n n—1  """ n—-k+1 n! (n—l—k)! 





2.32. Two balls are distributed at random and independently of one 
another among four cells which lie in a straight line. Each ball can 
fall in each cell with the same probability of 1/4. Find the probability 
that the balls will fall in adjacent cells. 

Solution. We divide the event A = {the balls fall in adjacent cells} 
into a sum of as many variants as there are pairs of adjacent cells we 
can form; we get A = A, + A, -+ Az, where 


A, = {the balls fall in the first and the second cell}; 

A, = {the balls fall in the second and the third cell}; 

A, = {the balls fall in the third and the fourth cell}. 
The probability of each variant is the same and equal to 


1 { 3 
ea gs eee 


2.33. k balls are distributed at random and independently of one 
another among 7 cells which lie in a straight line (A <i n). Find the 
probability that they will occupy & adjacent cells. 

Solution. We can choose & adjacent cells out of nin n — k + | ways. 
The probability that the & balls will fall in each group of adjacent cells 
is ok sh Gt ga — can be distributed among the cells in x! 
Ways). Lhe probability of the event A = in ft adj 
cells) is P (A) aa ny" a {the balls fall in & adjacent 
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234 One day a post office received 20 telegrams intended for four 
different addresses (five for each address} Four telegrams are chosen 
at random Find the probabilities of the following events 


A = {all the telegrams are intended for different addresses}, 
B = {all the telegrams are intended for the same address} 


Solution Fer the eventA taoccur the first telegram may be tntend 
ed fer any address the address of the second telegram must differ 
from that of the first one that of the third must differ from the addres 
ses of the first twa ind that of the fourth must differ from the addresses 
of the first three Bs the multzplication rule for probtbilities we have 


fo 410° § 
P( 1)—1 TS Tf jz 0 180 
Similarly 
P(B)—-t A ae Hw 0 00413, 


235 A computer consists of nm units The reliability (failure free 
performance) of the first umit for the time Tis p, that of the second unit 
Is Pp, and so on The units my fail independently of one another When 
any unit fails the computer fails Find the probability that the com 
puter will fail during the tame 7 

Answer 


i— [| P3 


236 When the ignition is turned on the engine pichs up with pro 
bability p Find (1} the probability that the engine picks up when the 
ignition 18 turned on for the second trme (2) the probability that 10 18 
necescary to switch on the ignition no more than two times for the 
engine te begin working 

Answer (1) (1 —p)p (2)1—(1—p) = (2—p)p 

237 Three messages are sent over 4 communication channel each 
of which my be transmitted with different accuracy The transmission 
of one message can lead to one of the following events 


A, — {the message 1s transmitted in a correct form} 
A, = {the message 1s partiall, distorted} 


A, — {the message 1s completely distorted} 


The probabiltties of the events A, A, and A, are known to equal p, 
DP, and ps (py + Pe. + Pai) Considering that messages maj be dis 


torted or transmitted correctly independentiy of ane another find the 
prebabilities of the following events 


A = {all three messages are transmitted 1n a correct form} 
4H = {at least one of the messages is completely distorted} 


& = {noless thin tuo messages are completely or partially distorted} 


Ch. 2. Algebra of Events. 48 


Answer. 
P(A)=p’, P(B)=1—(Pi+ Pe)?: 
P (C) =3 (p+ Ds)? Pi + (Pe + Ps): 


2 38. Two radar units are scanning a region of space in which a target 
is moving for a time t. During that time the first unit makes 2M sur- 
veillance cycles and the second unit 2m, cycles. During one surveillance 
cycle the first unit detects the target (independently of the other units) 
with probability p,, the second unit with probability po. Find the 
probabilities of the following events: 


A = {the target is detected in time t by at least one of the 
units}; 

B = {the target is detected by the first unit and is not detected 
by the second unit}; 


= {the target is not detected during the first half of the time t 
and is detected during the second half of the time}. 


— 


Solution. P(A)=1—P (A). 
A= {the object is not detected by either unit}; 
P(A) =(1—p,)°"2 (14 — py)", P(A) = 1—(L— 4)? (4 — pg)? 
P(B)=(1—(1—p,)"™] (1—p,)"™, 
P(C) =(4-— p,)"* (1 — pp)"* [1 — (1—p,)"* (1 — pp.) 1. 


2.89. During one surveillance cycle a radar installation can detect a 
target with probability p. How many surveillance cycles are needed for 
the target to be detected with a probability no less than £? 

Solution. We denote the unknown number of cycles by NV’. The con- 
dition 1 — (i — p)* > # must be fulfilled, whence it follows that 
(1 —p)’ <1 — §. Taking logarithms, we have 


N log (1— p)<log (1— #), 
N >log (1— #)/log (1— p). (2.39) 


2.40. A message being sent over a communication channel consists 
of n signs (symbols). During the transmission each Sign is distorted 
(independently of the other signs) with probability p. For the sake of 
reliability, each message is repeated k times. Find the probability that 
at least one of the messages being transmitted will not be distorted in 
any sign. 

Solution. The probability that one separate message will not be 


distorted is equal to (f — p)"; the probability that at least one out of 
ft messages will not be distorted is 


Pere hen yey, 
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941 Under the conditions of Problem 2 40 how many times must 
a message be repeated for the probability that at least one message 
will nat be distorted to be no less than 3°? 

Answer By formula (239} we have MN > log (1 — #)ilog [1 — 
(1 — py") 

242 A signiicant message 1s sent srmultaneously over 7 commani 
cation channels and 1s repeated & times over each channel for the sake 
of reliability During one transmission a message (independently of 
the other messages) 1s distorted with probability p Each communica 
tion channel (independenily of ihe other channels} 1s blocked up’ 
with noise with probability @ a blocked up channel cannot transmit 
any messages Find the probabrlity of the event 


A — {a message 1s transmitted in a correct form at least once} 
Solution We introduce the event 


8H — {a message 1s transmilted over one communication channel with 
out distortion at least once} 

For the event B ta cecur firat the channel must nat he “hlacked up 

with noise ind second at least one message sent over it must not be 


distorted 
P (B) — (1 — Q) (L — p*) 


The probahility of the event A which 1s that the event # occurs at 
least over one channel 1s 


P(A)=1—[1—P(s))" —-1-h-—-a—-—9O) d— pe 


243 An air battle between two aircraft a fighter and a bomber 1» 
going on The fighter 1s the first to fire It fres once at the bomber and 
brings it down with probability p, Hf the bomber is not brought down 
it fires once at the fighter and brings it down with probability p, If the 
fighter is not brought down it fires at the bomber again and brings it 


Gown with probability p, Find the prebabilities of the following out 
comes 


A = {the bomber 1s brought down} 

& — {the fighter is brought down} 

C = {at least one of the aircraft is brought down} 
Answer 


P(A) —p,t ( — py) (1— py} py P(B)-— (1 — py) pe 
P (C) = P (A) + PB) 


244 An air battle between a bomber and two attacking fighters 1s 
going on The bomber is the first to fire it fires once at each fighter and 
brings it down with probability p, Ifa fighter 1s not bro ught down iH 
fires at the bomber irrespective of the destiny of the other fighter and 
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brings it down with probability pp. Find the probabilities of the fol- 
lowing outcomes: 


A = {the bomber is brought down}; 
B = {both fighters are brought down}; 
C = {at least one fighter is brought down}; 
= {at least one aircraft is brought down}; 
E = {exactly one fighter is brought down}; 
F = {exactly one aircraft is brought down}. 
Solution. The probability of one of the fighters bringing down the 


bomber is (1 — p,) pe; the probability that neither of them brings 
down the bomber is [(1 — (14 — p,) pel*, whence } 


P(A)=1—[1—(i —p,) pp), P@) =p, 
P(Cc)=1—(1—p,)?, P@M)=1—(1—p,) (1 — Pe)’s 
P (£) = 2p, (1 — Pi). 


The event F can be represented in the form F = F, + F, + Fs, 
where 


F, = {the bomber is brought down and both fighters are safe}; 


F, = {the first fighter is brought down and the second fighter and the 
bomber are safe}; 


F, = {the second fighter is brought down and the first fighter and the 
bomber are safe}. 


P (Fy) = (1 — p,)? 1 — (2 — p,)?), 

P (Fy) = P (F3) = py (1 — pi) (L — Do), 

P (F) = (1 — p,)* 1 — (1 — pe)?] + 2p, (1 — py) (1 — pe). 
2.45. The conditions and the questions are the same as in the preced- 
ing problem, with the only difference that the fighters attack only 
- — if one of them is brought down, then the second one disen- 
. eels 

P(A) =(1—p,)? [1—(1—p,)*],  P (B) = p?, 
P(C)=1—(1—p,)?, P(D)=1— (1 — py)? (1— p,)?, 
P(E) = 2p, (L— p,), P(F) =(1— py)? [1—(4— p.)?] + 2p, (4 — p,). 
2.40. ¢ 
ier sae tall Godan, Gren wee ck eee 


The player who is the first to draw a white ball wins the game. Find the 


robability | } 
pre erate | #, of the first player (the one who begins the game) being 
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Solution The first player can win either in the first or in the third 
selection (in the latter case the first two times blacl balls must be drawn 
and the third time a white bali must be drawn) ind 80 on 


Si apet (ape) ape t tar) seer 


am f b \th a4 1 ath 
=o (ss) ~ ato b yo wee 
k—0 1-— (sar 
(it is evident that #, > 4/2 for any a@ and 8) 

247 There are two white and three black balls in an urn Two play 
ers each draw a ball in turn without replacing it The first player who 
13 the first to draw a white ball wins the game Find the probability 9, 
that the first player wins the game 


Solution 
7.32 2 «3 
P Ste TFs 


248 An instrument 1s being tested Upon each trral the instrument 
fails vith probability p After the first failure the instrument 1s re 
paired after the second failure it 18 considered to be unfit for operation 
Find the prebability that the instrument 1s rejected exactly in the Ath 
trial 

Solution For the given event to occur it 1s necessary first that the 
instrument shoujd fail in the Ath trial the probability of that event 
beng p In addition it 1s necessary that in the preceding & — 1 trials 
the instrument should fail exactly once the probability of that event 
being (A — 4) p(1—p)*? * The required probability is equal to 
(}— i)p (1 — py * 

249 Maussiles are fired af a target The probability of each missile 
hitting the target 1s p the hits are independent of one another Each 
missile which reaches the target brings 11 down with probability p, 
The missiles are fired until the target is brought down or the missile 
reserve is exhausted The reserve consists of m missiles (n >> 2) Find 
the probabtlity that some missiles will remain in the reserve 


Solution We pass to the complementary event A — {the whole 
reserve 1s exhausted} For A to oceur the first m — 1 missiles must not 
bring the target down 

P(A)—~(1—ppy)*', P(A)=1—(1— pp 

250 Under the conditions of the preceding problem find the proba 
bility that no less than two missiles remain im the reserve after the tar 
get 15 brought down 

Solution The complementary event A = {less than two mussiles 


remain in the reserve} 1s equivalent to the first n—~ 2 missiles not bring 
ing down the target 


P(A)=(1—pp)? P(A) =1—-(1 pp.) 
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9.51. Under the conditions of problem 2.49 find the probability 
that no more than two missiles will be fired. 

Solution. For no more than two missiles to be sent, the target must 
be brought down after the first two shots: the probability of this event 
is equal to 4 — (1 — pp,)’. . | | 

9.52. A radar unit tracks k targets. During a surveillance period 
the ith target may be lost with probability p; (i = 1, De pag ie) 
Find the probabilities of the following events : 


A = {none of the targets is lost}; 

B = {no less than one target is lost}; 

C = {no more than one target is lost}. 
Answer. 


kh Rk 
P(A)= [1 (f -pi), P(B)=1— J) L—pi 


i= 


Rk 
P(C)= Ll Gp + pi (1—py) --- (1 Pa) +1 — Pr) Po (1 — Pa) 


— 
— 


oe (1 pp) t+ --. + (L— py) 1 —p,) «(1 Pas) Pr- 


The last probability can be written in the form 
h 


kh R 
P(C)=[] Up) +3) 24] tee. 
j=t 


i=! 





i=1 


2.03. An instrument consisting of k units is in use for a period ¢ 
During that time, the first unit may fail with probability g,, the second 
with probability g, and so on. A repairman is summoned to check the 
instrument. He checks each unit and either locates and clears the fault, 
if one exists, with probability p or passes it as faultless with probability 
q = | — p. Find the probability of the event A = {at least one unit 
remains faulty after the inspections}. 

Solution. The probability that the ith unit remains faulty is equal 
to the probability that it became faulty during the time ¢t multiplied by 
the probability that the repairman failed to locate the fault: gig. The 
probability that this event will occur in at least one unit is 


k 
P(A)=1—|} (1—aua). 
= 
2.54. A new condition is added to those of Problem 2.53: after time t 
a repairman is not found with probability Q and the instrument is used 
without inspection. Find the probability of the event A = {the instru- 


ment is used with at least one faulty unit}. 
Answer. 


k k 
CQ U— UH d—aal +e tt — I] a). 
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my bmg bo mgt myg + mys + Mes + Mia, = Mm Twa people are cha 

sen from the group atrandom What 14 the probability p that they can 

use one of the three Languages to talk to each other without an inter 
reter? 

° Solution. We enumerate all the seven groups of people and write in 

front of aach group the languages which all the members of the group 

speak denoting them by the letters G, A and Ri 

(I} G (m, people}, (11) A (m, people}; (IIT} R (ma, people), (VI) G, A 
(my. people) (V)G, TK (m,, people), (VI) A, BR (mag, people}, (VET) G, 4 
Fi {7,25 people) 

For two people to talk to cach other, they must belong to a pair of 
groups which have a language incommon It 1s simpler in thts case to 
find the probability that two people cannot talk to each other They 
must then belang to one of the fallowing pairs (1, If), 1, TED), di, Vi), 
(ET U1) (27, V) dr IV) The prebahikittes that one of the two se 
lected people helongs to one group and the other to another group are 


P(I 11) =~, 
P(l 111) = P(I VI) == Stas 
PH, HY) = aa P (i V) = a, 


P (I, Iv) = 2. 


m im-— 4} 


Adding these probabilities and subtracting the resulting sum from 
unity, we find the required probability p 


p=i— 1} (10,17 MeHg PM Weg~] Mg My 4 MgMyy + MgIMy9} 


m (in 


260. A factory manufactures a certain type of article Each article 
may have a defect, the probability of whichisp A manufactured article 
is checked successively by 4 inspectors, the zth inspector detects a defect 
(if any) with probability p, (z = 4, 2, . &} If a defect ts detected, 
the article is rejected Find the probabilities of the following events 

A = {an article 15 rejected}, 


£ = {an article 1s rejected by the second inspec 
tor and not by the first}, 


C = {an article is rejected by all A inspectors} 
Answer, 


P(4)=p[1— ]] (~p)l, 


f-] 
P(B)=p(t—p)p, P(Cj=p Ul D; 
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9.61. A factory manufactures a certain type of article. Each article 
may have a defect with probability p. An article is checked by one inspec- 
tor who detects a defect with probability p,. If he does not detect a de- 
fect, he lets the article pass. In addition, the inspector may make 
a mistake and reject a flawless article, the probability of which event 
is a. Find the probabilities of the following events: 


A = {an article is rejected}; 
B = {an article is rejected by mistake}; 


C = {an article with a defect is passed to a lot of 
finished products}. 


Answer. 
P(A)=ppryt+(ii—p)e PB)=t—p)e, 
P (C) = p (1 — p)). 


2.62. The conditions are the same as in the preceding problem, but 
each article is checked by two inspectors. The probabilities that the 
first and the second inspector will reject a defective article are p, and p, 
respectively; the probabilities of rejecting a flawless article by mistake 
are a, and a, respectively. If at least one inspector rejects an article, 
it goes to waste. Find the probabilities of the same events. 

Answer. 


P(A)=p{t—(1— pi) A—p,)}+ 1—p) (1 — (4-2) (L—2,)], 
P(B) = (1~ p) (1-1 — a) C—o)I, 
P(C) = p (1 — px) (1 — Pe). L2yor 


2.63. An instrument consists of m units (Fig. 2.63), and a failure of 
any unit leads to afailure of the instrument as a whole. The units may 


: a 
6 2046 Fig. 2.63 Fig. 2.64 
fail independently. The reliability, (the probability of failure-free per- 
formance) of each unit is p. Find the reliability P of the whole instru- 
ment. What must be the reliability p, of each unit to ensure the relia- 
bility P, of the instrument? 
Remark. From now on elements without which a system cannot 


Operate are represented as links connected in series: elements which 


repeat each other are connected in parallel. The reliability of each 
element is written in a respective square. 


Answer. P = p", p, = 7 Py ES . - \ pag | 


4* 
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964 To increase the reliabtlity of an instrument, it 1s repeated by 
another instrument of the same kind (Fig 2 64) the reliability (the 
probability of fatlure free performance) of each instrument is p When 
the first instrument fails, the second instrument is instantaneously 
switched on (the reliability of the switching device 1s equal to unity) 
Find the reliabiltty P of a system of two instruments which repeat 
each other 

Solution For the system to fail, the two instruments must fail 
simultaneously, the reliability of the system P = 1 — (1 — pF 

265 The same problem, but the reliability of the switching device 
Sw is p, (Fig 2 65) 

Answer The reliability of the system P = 1—- (1 — p) (1 — pyp) 

266 To increase the reliability of an mstrument it 19 repeated by 
(1 — 1) instruments of the same kind ‘(Fig 2 66), the reliability of 





Sw 
Fig 260 Fig 2.66 


each instrument is p Find the reliability P of the system How many 
instruments must be used to wncrease the reliabrlity to the assigned value 

? 

1 

Answer P = 1— (i —p)" n> log (1 — P,)/log (1 — p} 

267 The same problem but a device with reliability p, 18 used to 
switch on every stand by instrument (Fig 2 67) 

Answer 


PaA—(t—p)(i—pypy" , np eda Pybogt—o) 4 4 


268* A system consists of m units the reliability of each of which 
isp «A failure of at least one unit leads to the failure of the whole system 
To increase the reliability of the system its operation 1s repeated, far 
which purpose another 7 untts are allotted The switching devices are 
completely reliable Determine which of the following repeating tech 
niques 1g the more reliable (a) each unit 1s repeated (Fig 2 68a} {b} the 
whole system 1s repeated (Fig 2 685) 

Sohition The relrability of the system repeated by technique (a) 1$ 
p, = li — (1 — py" and that of the system repeated by techmque (b) 
ts Pp = 1 — (1 — p*} Let us show that p, > p, for any n> 1 and 
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O< p< i. Since 
p,=[i—(U— pyr = — 14+ 2p Pe =P (2— p)”, 
np =t—(1— pr)? = 1-1 + 2p" — pp =P" (2—P): 


— p)" —p”. We set g=1— 
it J ‘ont to prove that (2 —p)" >2—p | = 
i oo the inequality assumes the form (2 — 1+ 4)" > 2 





Fig. 2.68 


{ —g)", or A +)" + (1 —q)">2. Applying the binomial theorem, 
we note that all the negative terms are eliminated: 


(1+ 9)" -+ (Lg) =1-tng +22 E9 get. 


+i-ng+ 22) a... 


=2t+n(n—i1)qg?+...>2, 
and this proves the required inequality. 





Fig. 2.69 Fig. 2.70 


2.69. In a technical system not all units are repeated but only some 
of them which are less reliable. The reliabilities of the units are shown 
in Fig. 2.69. Find the reliability P of the system. 

Answer. P = [1 — (1 — p, 111 — (4 — p.)lp, py [4 —  — p,)? I. 

2.70. An instrument consists of three units. The first unit contains Thy 
elements, the second contains nm. elements and the third contains ns, ele- 


54 Applied Problema in Probabiluy Theory 


ments For the instrument to function, unit [1s obviously necessary 
the two other units 1] and lil repeat each other (Fig 2 70) The relia 
bility of the elements 1s the same and equal to p A failure of one ele 
ment means a failure of the whole unit The elements far] independentl, 
of one another Find the rehability P of the matrument 

Solution The reliability of unit I is py = p™1, the reliability of 
unit II is pry = p™ the reliabtlity of unit TT 1s pyry = p"?, the relia 
bility of the repeaters (il and 11} 13 4 — (4 — p™) (1 — p%s} the 
reliability of the imstrument 1s 


Pex pr [£—(1— p?)} (1 — p*)] 


271 There rs an electrical device which can fail (burn out) only at 
the moment when it 1s switched on If the device has been switched on 
k — 1 times and hes not burned out, then the conditional probability 


of itsburnimgout on the Ath switching operationis @, Find tbe proba 
bilzties of the following events 


A = {the device withstands no less than n switching 
Operations}, 


f = (the device withstands no more than mn switching 
operations}, 


C = {the device burns out exactly on the rth switching 
operation} 


Solution The probability of the event A is equal ta the probability 
that the device will not burn out on the first n switching operations 


P(Ay= |] 4 —-0,) 
A--1 


To find the probability of the event 2 we pass to a complementary 


event B = {the device will withstand more than nr switching opera 


tions} For that event to occur, 1t 15 suffierent that the device should 
not burn out on the first (nm ++ 1) operations 


ri-+1 


_ n+i 
P= MG) PB) =1~ Uf 4 —@n 


For the device to burn out exactly on the nth switching operation 1 


1g necessary that rt should net burn out on the first {n —i} operations 
and should burn out on the ath operation 


n—i 
P(C}=On L (L—@). 


2/2 An instrument consists of four units two of them (I and I) 
are obviously necessary for the instrument to function and the other 
two (TTI and IV) repeat each other (Fig 272) The units can only fall 


when the} are switched on On the “th switching operation unit 1 fails 


Ch. 2. Algebra of Events D0 


ndently of the other units) with probability gr (#), unit ii with 

oh bute girl), unit III and unit IV fail with the same probabil- 
ity grrr (k) = Qrv(k) = q (&). Find the probabilities of the events A, 
B, C as in Problem 2.71. . 

Solution. The problem reduces to the preceding problem when the 
conditional probability Q;, that a sound device will fail on the Ath swit- 
ching operation is found: Q, =1—Il1—4q (k)] [4 — grr(k)] Xx 
(41 — (4 —q(k))*], and is substituted 
into the solution obtained. 

2.73. An instrument consists of three 
units. When the instrument is switched 
on, a fault occurs in the first unit with 
probability p,, in the second unit with . 
probability p,, and in the third unit Fig. 2.72 
with probability ps. Faults occur in the 
units independently of one another. Each of the three units is obvi- 
ously necessary for the instrument to function. For a unit to fail com- 
pletely atleast two faults must occur. Find the probability of an event 





A = {the device withstands n switching operations}. 


Solution. For the event A to occur, itis necessary that all the three 
units should function. The probability that the first unit withstands n 
switching operations is equal to the probability that no more than one 
fault (0 or 1) occurs when it is switched on nm times: (1 + p,)” + 


np, (1 — p,)""*. The probability that all the three units withstand 
2 switching operations is 


3 
P(A) = [1d — pi)" -+ np; (4-2). 


2.74, An instrument consists of three units, only one of which is 
necessary for the instrument to function, the other two repeat each other. 
Faults only occur in the instrument when it is functioning and can 
occur in any of the components constituting the units with the same 
probability. The first unit consists of n, components, the second of np 
components, the third of nm; components (nm, + mn, + nz =n). When 
a fault occurs in at least one component the unit fails. 

Four faults are known to have occurred in the in 
different components). Find the probability 
instrument from functioning. 


_ Solution. An event A = {the instrument cannot function} is divided 
in lwo: A = A,-+A,, where 


Strument (in four 
that these faults prevent the 


A, = {the first unit fails}; 


A, = {the first unit does not fail but the second and 


the third do}. 
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For the event A, to occur, it 18 Hecessary that at least one of the four 
faults be in the first unil 


P(A) = 1 P(A)j=1 i= ity n—n,—1 mR— hyo 2 thy -—-3 
47 3 {io aA 7 


To find the probability of the event A, tho probabil:ty of the event 


A, =({the first unit does not fail} must be multiplied by the probabil: 
ity that the second and third units ful (with due regard for the fact 
that vl the four fauits occur in the second ang third units} ‘The last 
event may be in three variants either one fault occurs in the second 
unitand the other three in the third unit or conversely, three faults occur 
in the second unit and one fault occurs in the third unit, or else two 
faults occur in the second and in the third unit each 
The probability of the first variint is 


1 


ee es ell 


<n Ly Slee ae 

4 Fig —+ ia Fig Ma+— 4 Mg+My—2 Nac > Ay a + 
And the probability of the third variant 1s 

¢ My Fig—1 fq awl — - 


Hence 
P(A J—(1— PRAM (2,4 £48.) P(A P (ASSP (A) 


275 An instrument whick must be very relzable ts assembled from 4 
partis D, BD, D, Before the assembly starts each part 18 inspected 
thoroughly and +f it proves to be of very high quality 1s included 
m the instrument and if not is replaced by another part, which 1 
also inspected There 1s a stock of spare parts of each type m, parts of 


h 
type DD, (¢= 1, ,k), a total of m — YS’ m, parts If there are 


=1 
not enough spare parts, the assembly is postponed The probability 
that a part of type D,; proves to be of high quality 1s equal to p; and does 


not depend on the quality of the other parts Find the probabilities 
of the following events 


A = {the stock of spare parts is sufficient for the assembly 
of the instrument}, 


{all the spare parts have heen used (tested and 
intluded in the instrument or only tested)}, 


C = {using the asailable stock of spare parts the fitter, 


will assemble the instrument and at least one spare 
part will remain} 


B 


li 
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k 
Solution. The event A = | A;, where A; = {at least one part 


i=! 
of type D; proves to be high quality}. 
h oe 
P(A) =1—(1—p)"', P(A)= HCP) I. 


k 
The event B= jj 38i, where B; = {all the parts of type D; have been 
{ 


j= 
used}. For event B; to occur, the first m; — 4 parts of type D; must be 
low quality: 


k 
mm m.=—1 
P(B)=(1— pi), P(B)=U—p)* . 
i= 
To find P (C), we represent the event A as a sum of mutually exclu- 
Sive events 


A=C++F, | (2.75) 


where F = {the fitter manages to assemble the instrument but no 
h 


spare parts remain instock}; F = || F;, where F, = {the first m; — 1 


i=1 
parts of type D; prove to be low quality and the m;th part proves to 
be high quality}. 


R —_ 
P(F,)=(1—p;) i, P(F)= LI (4—p * pil. 


From formula (2.75) we have 
h h 
P(C)=P(4)—P(F)= |] 4-4 — Ht a) pal 


2.46. A device S consists of m units, each of which may end up in 
one of the following states as a result of its operation for the time Tt: 


Ss; = {the unit is in good order}; 
S. = {the unit must be adjusted}; 
Ss = {the unit must be repaired}; 
Sg = {the unit is out of order}. 
P (s;) = Py, P (Sg) == Pe, P (Ss) = ps3, P (Sa) = Pa, 
Py + Pe + Ps + py = 1. 


The states of separate units are independent. Find the probabilities 
of the following events: 


A = {all the units are in good order}; 
B= {all the units must be adjusted}; 
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C = {one unit must be repaired and the other units must 
be adjusted}, 


D — {at least one unit 13 completely out of order}, 
E = {two units must be adjusted one unit must be repaired, 
and the other units are in good order} 


Solution P (A) = pt, P (2) — py One unit, which must be repaired, 
can be chosen in C), = nm ways 


P(C)— mpspt? > P{(P) = 1— (1 — py. 


Two units which must be 1djusted can be chosen out of 7 units in 


2 niin—l) 
t é 
mC), wn 2 ways 


ways one umt which must be repared can be chosen 


n—{ 
P(E)= "29 (n—2) ptp, * 


277 Six messiges are sent over 1 cOmmunication channel, each of 
which independeatiy of ather mussages may be distorted with probability 
p=02 Find the probabilities of the followimyg events 


C = f{exactl) two messages of the six are distorted}, 
D = {no less than two messages of the six are distorted} 
Solution By the theorem on a repetition of trrals [see formula (2 0 15)] 
D(C) = Ppg= €202708 20197 By formula (2018) we have 
P(D)=1—(Poe t+ Pig} = 1 — (08 +602 0 85) 
= 1 — (0 262 + 0 393) = 0 345 
278 A total of m messages are sent over a communication channel 


Bach of them may be distorted by interference mndependently of the 


other messages with probability p Find the probabilities of the fol 
lowing events 


A = {exactly m of the n messages are distorted), 


B = {no less than m messages of the nm are transmitted 
without distortion}, 


C= {no more than half of the messages are distorted}, 
D = {all the messaves are transmitted without distortion}, 


& = {00 less than two messages are distorted} 


Solution By the theorem on a repetition of trials [see formu 
la (20 153] 


P(A) = Chp™ (1 — py ™ 
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Using formula (2.0.17) and replacing p by 1 — p, we obtain 
n [n/2] 
P(B)= >) Ch(L—p)t pp", P(C)= XB Cup" (1— py", 
k==m = 
where (n/2] is an integral part of the number n/2. 
P (D) = (h — py", 
the same value can be obtained from formula (2.0.19).: 
P (D) = Po, = Cop* (1 — p)® = 1-1: Ad — py’. 
By formula (2.0.18) we find that 


{ 
P (LE) = Ro, noi 2 Cp" (1 — pyre 


= 4—[(1— p)"+- np (1— py") 
= 41—(1-- p)" [1+ (n—1) pl. 

2.79. A device S consists of five units, each of which may fail during 
its operation with probability p=0.4. Units fail independently of one 
another. If more than three units fail, the device cannot function; if 
one or two units fail, the device functions but with a lower efficiency. 
Find the probabilities of the following events: 

A = {not a single unit fails in the device}; 
B = {the device can function}; 


= {the device functions with a lower efficiency}. 
Solution. 
P (A) = 0.65 ~ 0.0778, P(B)=P(A)+P(C)4+P(D), 
where C = {exactly one unit fails}; D = {exactly two units fail}. 
P (C) = Pys = 5-0.4-0.64 ~ 0.259, 
P (D) = Po = C2-0.47-0.68 0.346, 
P(B) = P (A) + P(C) + PD) 0.683, 
P(F) =P (C) + P (DW) ~ 0.605. 
2,80*. There is a contest belween & marksmen, each of which fires n 
shots at his target. The probability of hitting the target on one shot is 


pi (t=1, ..., k) for the ith marksman. The marksman who hits a tar- 
get the most wins the contest. Find the probability that one and only 
one marksman will be the winner. 

Solution. Any of the / marksmen may win. We find the probability 
that the ith marksman is the winner (event A;). This event can occur in 
the following ways: ACP = {the ith participant hits the target exact- 


ly m \imes and each of the other participants makes no more than 
m—1 hits} (m= 1, ..., 7). 
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The probalslity P,, (4) that the ith marksman makes m hits 1s equal 
to C™p%™g"-", where g; = 1—p, We designate the probability 
that the jth marksman makes no more than m~1 hits as &,, (fj 


i= 1 


Ry (Q) = yy Crpiqr 7? (m> 1). 


Then the probability that all the other participants, except for the 
rth, make no more than m-—~1 hits, 1s 


fin (1) Ria (2) * Rent (r—— 1) Riyat (i -}+ 1) - * Fiat (He) = NI Rn (7) 
Summing up the probabilities obtained for all the values of m, we 


get the probability that the th participant is the only winner of the 
contest 


P(Ad= 2 Pmt) YP Ams) G=t, >A) 


Summing up these probabilines for all the participants, we obtain 


k ah n 
P(4)= DP(4p= 2 DD Pri) [E Rms 
i=t i-=1 m=? fed 


2.81. A family who got a new flat installed 24 new electric lamps In 
the course of a year each lamp may burn out with probability r Find the 
probability of an event A = {in the course of a year no les» than half 
of the lamps will have to be replaced} 

Answer, 


Au» j 
P(A)=1— 5) Chr™(4—r)-™ 
m—( 


2.82, A factory manufactures articles, each of which, independently of 
the other articles, may have a defect with probability r When an art 
cle is inspected, any defect may be detected with probability p The 
checking operation consists rn choosing nm articles for inspection Find 
the probabilities of the following events 


A = {no defects are detected in any of the articles}, 
& = {a defect 1s detected in exactly two of the articles} 


C = {a defect 1s detected in no less than two of the 
mn articles}, 


Solution. The probability that one article chosen at random contains 
a defect which is detected is pr 


P(A) = (1 — pr)", P (B) = Ct (pry? 1 — pr), 
P (G) = 1 — (1 — pr)*-! [1 — pr) + npr] 


2.83. The conditions are the same as in Problem 2 82 but now the 
whole batch of articles chosen for the checking operation 1s rejected 1f 
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no jess than four articles among the chosen 7 have defects. Find the 
probability p that the whole batch of articles chosen for inspection 
is rejected. 


ANS ver. 
p= 24 Cn (pr) (1— pry. 


2.84. Given two instruments, the first of which consists of n, units 
and the second consists of n, units. Each instrument operates for 
4 time t. In the course of that time each unit of the first instrument may, 
independently of the other units, fail with probability g, and each unit 
of the other instrument may fail with probability qg.. Find the proba- 
bility p that during the time ¢ m, units will fail in the first instrument 
and m, units will fail in the second instrument. 

Answer. 


p=Crig? (1—a,)""-™ Cregs? (1— 99)". 


2.85. A coin is tossed m times. Find the probability that the heads 


will occur no less than & times and no more than / times (ASM I1< m). 
Solution. 


[ i l 
p= 2 Pim = 2) Cm (1/2)" = (1/2)" 2) Cr. 


2.86. An instrument which consists of / units operates for a time 7. 
The reliability (the probability of failure-free performance) of each 
unit during the time ¢ is p. When the time ¢ passes, the instrument 
stops functioning, a technician inspects it and replaces the units that 
failed. He needs a time v to replace one unit. Find the probability P 
in the time 27 after the stop the instrument will be ready for 
work. 

Solution. For the conditions of the problem to be fulfilled, it is neces- 
sary that no more than two units should fail during the time ?: 


P= ph+k(1—p) p++ 20-9 (4 pyrpr, 


2.87. What is more probable, when playing with a person of the same 
ability, to win ({) three games out of four or five games out of eight? 
re less than three games out of four or at least five games out of 
elgnt: 

Solution. (1) A = {winning 3 games out of 4}; B = {winning 5 games 
2B) S}. P (A) = Cy (1/2)* = 1/4, P (B) = C® (1/2)8 = 7/32 P A) > 
(2) Cea {winning no less than 3 games out of 44; D = Swinni 
less than © games out of 8}; P (C) = C§ (1/2)* 4- (4/2)! = sie: P (D) = 
Cy (1/2)8 + Cy (4/2)8 + C2 (1/2)8 +- (1/2)8 = 93/256; P (D) > P (C). 

2.88. A person belonging Lo a certain group of cilizens may be dark- 
haired with probability 0.2, brown-haired with probability 0.3, fair- 
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haired with probability 0 4 anired haired with probability 0 1 A group 
of six people ts selected at random Find the probabilities of the fol 
lowing events 
A — {there are no less than four far haired people in the 
chosen group} 


B — {there 15 no less than one red haired person in the group} 


C — {there 1s an equal number of fair haared and brown 
haired people in the group} 


Solution 
P (Ay ~ 1 —{1008 +6 x 04065 4+ 15 x 04% «% OG) = O 455 
P (By) — 1 — tt —O01)% ~ 0 468 G=C€,+¢C¢,+¢,-4+¢, 


where 
C, {there are neither far haired nor brown haired 
people in the group} 


C, = {there 1s one fair hatred and one brown hatred 
person in the group and the other people are 
neither fair haired nor brown hired} 


C, — {there are two fair haired and two brown haired 
people in the group and the other people are 
neither fair haired nor brown harred} 


C, = {there are three fair haired and three brown 
haired people in the group} 


P (C4) == (4 —0 7)8 x 0 0007 


P(C) — aap 0 8X 04 (10 7) mw 0 0292 


P(C,) — sarap 0 8? x 0 42(1—0 7)? & 0 1166 


P(C;)— a 0 33 x 0 49 0 0346 P(C) 0 184 


283 N instruments operate for a period of tumet Each istrument 
has 1 reliability p and fails independently of the other instruments 
Find the probthility P (A} that the repairman who 1s called after the 
time ¢ to repair the faulty instruments will not make the repairs tn 
atime tf he nee ls 1 time tT, to repair one faulty instrument 

Solution The cvent A consists in the number of faulty instruments 


rarger thin £ — [t/t,] where [1/1,] 1s the greatest integer rnclude | in 
T/T, 


Ny 
P(A)— 2) CN(L— py” po-™ 
fa {+41 


290 §N faulty instruments are tested to locate a defect In each test 
independent of the other tests a defect may be located with prebabilt 
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ty p. When a defect has been located, the instrument is passed to a re- 
pair shop and the other instruments are tested. When the defects in 
all the NV instruments are located, the tests are terminated. The inspec- 
tion procedure only allows n tests (n > NV). Find the probability that 
the defects in all the NV instruments will be located. 

Solution. A = {all the defects are located} = {the defects are lo- 
cated at least NV times}. 


n 
P(A)= >) Mp" (1— p)"—™. 
m=-N 

2.91. The conditions are the same as in the preceding problem. Find 
the probability that as a result of m tests at least & instruments of the 
N remain with unlocated defects (« < N). 

Solution. The problem is equivalent to finding the probability that 
in n tests the defects are located in no more than V — k instruments. 


N-k 
P(A) = ay Crp py. 


2.92", An instrument consists of m units. The probability that the 
ith unit will fail is p; (i = 1,2,...,”). For the instrument to function, 
all the units must operate without failure. To calculate the probabili- 
ty AR that the instrument fails, the probabilities p; (i = 1, 2, ..., n) 
are approximated by their arithmetic mean: 


~w 4 = 
p=— D; Dis (2.92) 
i=1 ; 


Will the approximation F# of the probability R be greater or smaller 
than the true R? 


Tt 
Solution. The exact value R = 1— lI Qi, Where g; =1— p;. 
i=1 


The approximate value (in the mean probability P 
R=1—(1—py"=1—[— (n— 3 a) =1-[4 Da)’. 
i=! 


Tr 7 
; ae 1 n 
We must compare the quantities il q; and | — >; a: | . The geo- 
| ix! ix1 
metric mean of unequal positive values is known to be smaller than 
their arithmetic mean, whence it follows that 


nf n- n n n 
V Ia<a da Ja<|—del. 
is i==1 i==[ j=1 


and consequently R < R. 
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293 The articies a factory manufactures must each undergo four 
tests An article may pass the first test safely with probabshity 0 9, the 
second test with probability 095, the third test with probability 08 
and the fourth test with probability 0 85 Find the probability that 
the article will pass 


A = {all the four tests}, 
B= fexactly two tests}, 
C = fat least two tests}. 


Answer P (A) ~ 0 581, P (8) ~0 070, P(C) v0 994 

294 A message consists of n symbols and to increase the reliabulity 
of transmission each symbol is repeated m times A valid symbol! at the 
receiving end is that whichis repeated at least & times out of m If, at 
the recelving end, a symbol ts repeated less than A times, the symbol! 
Is not recognized and 1s considered to be distorted The probability pof 
any symbol being transmitted correctly is the same and does not depend 
on whether the other symbols are recognized Tind the probabrlities of 
the following events 


A = {a symbol in the message will be recognized at the 
recelying end} 


B = {the whole message will be recognized at the receiving 
enc} 


¢ = {no more than ? symbols will be distorted in the 
message} 


Solution For asymbeol to be recognized at the receiving end it must 
be repeated without distortion no less than A times out of m The prob 
ability that a symbot will be reproduced correctly 7 times out of m 
din iccordance with formula (2 0 15)] 18 


Cap? (b= pyr? 


The probability that a symbel will be transmitted in a correct form 
no less than A times out of m can be calculated by formula (2 0 17) 


P(A)= DC (t— py” 
or for a comparatively smal! fe <zme/2 by formula (2 0 18) 
P(A) = >) Crp? (1— py"? 
For the whole message to be recognized at the recelying end all nsym 


bols must be reproduced correctly 


P (8) = (P (Ap 
The probability of the event C can be calculated by the formula 
i 
P (C) = 2 [1 P(A)]' EP (A) 


i= 


CHAPTER 3 


The Total Probability Formula 
and Bayes’s Theorem 


3.0. If n mutually exclusive hypotheses H;, Ho, ..., Hy, can be made concerning 


the staging of an experiment, and if an event A can occur only together with one of 
these hypotheses, then 


P(A)= 5) P(Hi) P (AIH), (3.0.1) 
ix4 


where P (H;) is the probability of the hypothesis H;: P (A | #4;) is the conditional 
probability of the event A on that assumption. Formula (3.0.1) is known as the fotal 
probability formula. 
If, before the experiment was carried out, the probabilities of the hypotheses 
H,, Ho, ..., H, were equal to P (H;), P (H,), ..., P (H,), and the experiment resulted 
in an event A, then the new (conditional) probabilities of the hypotheses can 


be calculated by the formula 
P (H;) P (Al H; 
P (H;|4)=—— (77;) P (Al #3) 


21 P (Hi) P(ALH)) 


1 


(i=1,2 ..., n). (3.0.2) 


Formula (3.0.2) expresses Bayes’s theorem or the inverse probability theorem, 
The initial probabilities (before the experiment) of the hypotheses P (H,), P (#2). 
..., P (H,,) are called a priori, or prior, probabilities and the post-experiment prob- 
abilities P (H,| A), P (H2| A), .... P (H, | A) are called a posteriori, or inverse, 
probabilities. Bayes’s theorem makes it possible to “revise” the possibilities of 
the hypotheses regarding the result of the experiment. 

an experiment resulting in an event A is succeeded by one more experiment as 
a result of which an event B may occur, then the probability (conditional) of the 
event B can be calculated by the total probability formula into which new proba- 
bilities of hypotheses P (H; | A) are substituted instead of the former ones 


P (B\A)= >) P(H;|4) P (BLH;A). (3.0.3) 


i=1 


ee (3.0.3) is sometimes called the “formula for the probabilities of future 


Problems and Exercises 


3.1. We have three identical urns. The first urn contains a@ whi 
rhite 

and b black balls, the second urn contains c¢ white and d black erie 

and the third urn contains only white balls. A ball is drawn at random 


— of ree wage a the probability that the ball is white. 
ution. Assume that an event A = fan a 
ball}. We formulate the hypotheses: ; — 


H,={the first urn is selected}; 


H,={the second urn is selected}; 
5—0575 
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Hf,= {the third urn 1s selected} 


P{H,)—P(H,)—-P(H)=3 P(A) = op 





P(i|#,)= T3 P (Al i,) — 1 


By the total probability formula we have 
{ a 4 Cc t { tt ¢ 
PAs agety cate es lapr tee t)) 


32 An instrument can operate under two kinds of conditions 
normal and abnormal Normal conditions are observed in 80 per cent 
of all cases and abnormal in 20 per cent of cases The probability that 
the instrument fails during a time ¢ in nermal conditions 13041 and im 
abnormal conditions 1t may fal with probability 07 Find the total 
probibility p that the instrument fails during the time f¢ 

Solution p—0801+02 x O07 — 922 

33 The articles a factory manufactures may each have a defect 
with probability p There are three inspectors in the shop each article 
is only checked by one inspector (by the first the second or the third 
inspector with equal probability) The probability of detecting the 
defect (if any} for the ith inspector 1s p, (f = 1 2 3) If an article 1s 
not rejected in the shop it passes to the quality control department of 
the factory where a defect may he detected with probability p, Find 
the probabilities of the following events 


A = {the article is rejected} 

B -— {the article 1s rejected in the shop} 

¢ = {the article 1s rejected by the quality control 
department} 


Solution Since the events #8 and C are mutually exclusive and 
A=H+C¢ it follows that P(A)—P(B)4+P(C}) We find P(B) For 
an article to be rejected in the shop first it must have a defect 
and second the defect must be detected By the total probability 


formula the probability that the defect will be detected 15s = (pst 
1 

Pot ps) hence P(B}— 3 P (pyt+ pat Bs) 

similarly P(C)= p | 4 — + (Py + Pat pa) | Po or using the neta 

1 oe _— — 

tion -- (Pit Prt p3)— Pp we have P(B)= pp P(C) = pp,{t — Pp) 
whence P(A} — pip + py (1 — py 

34 We hie two urns The first contains 24 white and b black balls 
and the second contains ¢ whrte and d black balls <A ball is drawn at 


tandom from the first urn and put into the second Then a ball 1s drawn 
from the second urn Find the probability that the ball is white 
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Solution. An event A = {an appearance of a white ball}; the hypo- 
theses are 
H,={a white ball has been transferred}; 


H,={a black ball has been transferred}. 


b 
P(A) =s75 Pfs) = Tay 
+4 
P(A|Hy) =—raeT 
P(AlH.)=—gqT 
LT eo 
(A)=—p epatl | apo edt * 


3.5. On the hypothesis of the preceding problem three balls are 
drawn from the first urn and put into the second (it is assumed that 
a> 3, b> 3). Find the probability that a white ball will be drawn 
from the second urn. 

Solution. We could advance the following four hypotheses: 


H, = {3 white balls were transferred}; 
H, = {2 white balls and 4 black ball were transferred}; 
H,= {1 white ball and 2 black balls were transferred}; 
H, = {3 black balls were transferred}. 


But it is easier to solve the problem having only two hypotheses, viz. 


H, = {the ball drawn from the second urn belonged to 
the first urn}; 


Hf, = {the ball drawn from the second urn belonged to the 
second urn}. 


Since three balls from the second urn belonged to the first urn and 
c-+d halls belonged to the second urn, it follows that P (H,) = 
d/(e + d+ 3), P(A.) = (c + d)/ (ce + d + 38). 

Let us find the conditional probabilities of the event A = {a white 
ball is drawn from the second urn} on the hypotheses H, and H,. The 
probability of an appearance of a white ball belonging to the first urn 
does not depend on whether the ball was drawn directly from the first 
urn or after it had been transferred to the second urn. Therefore, 


P (A|H,)=— P (A| H,) = — 








a+-b ” c-+-d ? 

whence 
PU 
(4) c+ d-+-3 oe ¢--d-+-3 e+d * 


gah a iy nm urns, each of which contains a white and b black 


is drawn from the first urn and put into the second, then 
5* 
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a ball is drawn from the second urn and put into the third one and so 
on Then a ball is drawn from the last urn Find the probability that 
the ball is white 

Solution The probability of an event A, = {a white hall is drawn 
from the second urn after the transfer} can be found in the same way as 
if was done in Problem 309 (for ce =a, d= 8 


a a+ J b a _ a 
P(A.) ry GpbEL Cape apopl apd 


Thus the probability that a white ball 1s drawn from the second urn 
after it has been transferred 1s the same as before the transfer Con 
sequently the probability of drawing a white ball from the third, the 
fourth the nth urn 1s the same 


P (A,) = a/(a + 8) 


3 7 Instruments of the same hind are manufactured by two factories, 
the first factory produces 2/3 of all the instruments and the second iac- 
tory produces 1/3 The reliability of an instrument manufactured by 
the first factory 1s p, and that of an instrument manufactured by the 
second factory is p, Find the total (average) reliabtlity p of an instre 
ment produced by the two factories 

Answer 


2/3p, + 1/3 p, 


38 There are two batches of articles of the same kind The first batch 
consists of V articles of which m arefaulty Thesecond batch consists of 
AF articles of which m are faulty articles are selected at random from 
the first batch and / articles from the second (K < VN, £<t Af) These 
A + i articles are mixed and a new batch 1s formed An article 13 
selected at random from the mixed batch Find the probability that 
the article ts faulty 

Solution An event A = {the article 1s faulty} The hypotheses 
Hf, = {the article belongs to the first batch}, 

Mf, = {the article belongs to the second batch} 
K iL K Yn i mm 

P (Hs) = K+i ' P(H,) = K-+L * P(A)= KE Wor KL M"* 

39 On the hypothes:s of the preceding problem three articles are 
selected from the new, mixed, batch Find the probability that at 
least one of the three articles ts faulty 

solution The hypotheses are 


ffi, = {the three articles belong to the first batch}, 
Ht, = Yuwo articles ‘pelong to the tirst ‘batch and one 
to the second batch}, 


4i, = {one article belongs to the first batch and two 
to the second batch}, 
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H, = {all the three articles belong to the second 
batch}. 
K(K—1) (K—2) 
P (Hy) = (RL) (K--L—1) (K+L—2) ’ 
3K (K—A)L 
P(A) = RET REL) REED 
SKE (L234) 
P (4s) = EEE) (K-LE—t) (K+ L—2) ’ 
L (L—1) (L—2) 
P (4s) = TEED (KFL—D (KTL—D ” 
(N—~n) (N~—n—1) (N—n—2) 
_ N (N—1) (N—2) = 
(N —n) (N ~n—1) (M—m) 
N(N—-)M 
(N —n) (M —~—m) (AJ —~m—1) 
NM (M—1) a 
4. (M~—m) (MT —m —1) (A —m—2) 
(lA) = M (M—1) (M—2) 
P (A) = P (Ho) P (A] Ho) + P (A4) P (Aly) 
+ P (H,) P (A[H_)-+P (3) P (AlZ5)- 


P(A|H,) = 1 
P (A|.H,)= 1— 
P (AJH,)=1— 


vA 

3.107 There are two boxes of identical articles, some of which 
are sound and the others are faulty. The first box contains a sound 
articles and b faulty ones, and the second box contains c sound articles 
and d faulty ones. An article is drawn from the first box at 
random and put into the second box. After the articles in the 
second box are stirred, an article is drawn at random from the second 
box and put into the first box. Then an article is drawn from the first 
hox at random. Find the probability that the article is sound. 

Solution. The hypotheses are 


H, = {the content of the articles in the first box has not 
changed}; 
Hf, = {one faulty article in the first box has been replaced 
by a sound one}; 


fi, = {one sound article in the first box has been replaced 
by a faulty one}. 


An event 4 = {a sound article is drawn from the first 
box after the transfer}. 


_ a c-+-1 b d+1 
oad dears fen Tt ete eo 
fi 5 Cc 
P (H,) = atb e+d+} 9 
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a a 
P(Hs)= Tp pda 

a c-+- di 4 5 d+ 4 a 
a-b epd+i ! a+b ctdtt } a+b 
” b c ati 

a-b e+d+t+t até 
ci d a—1 
+ a+b e+dt+it a+d 

aiatbyfet+d4tij+tbe—ad a 

(a+b fef att) ape 
br—ad 
(a+ 5)* (e-- d+ 1) 

This solution shows that the probability that the selected article 
is sound does not change if the quantities of sound and faulty arti 
clesinthe urns areequal ¢/a = d/b 1e be — ad == 0 

3.11 Two numbers are selected at random from the series 1, 2, ft 
What is the probability that the difference between the first and the 
second chosen number is no less than m (m = O}T 

Solution An event A consists in the difference between the first select 
ed number A and the second number / being no less than m 
(1e A—iz= m) The hypotheses are 


H, = {the first selected number is A} (A= m-+4, . «5 M) 
PUH,}=1/n P(AJH,)=(k—m)i(n—1), 





P(A) = ( 


4 


FT 


P= Do ees ltt 2+ + (nm) 


mimn—i) Rin 
bm+i 


_(a—m) (n—m+4) 
- 2n(n—1) 


3.12 Four groups can be formed from V marksmen a, excellent marks 
meh @, good ones, a; fair ones and @, poor marksmen A marksman 
from the ith group may hit a target in one shot with probability p; 
{i = 1, 2, 3, 4) Two marksmen are selected at random to fire at the 
Same target Find the probability that the target will be hit at least 
once 

Solution. Anevent A = {the target 1s hit at least once} The hypothe 
ses are a 3 ta marksman from the tth group 1s the first to be selected} 

tz= 1, 2, }) 


4 
PAH Yo , Bhada=n So ZED CAVES, 


where P (4d | #;} may again be found from the total probability 
formula on four hypotheses concerning the marksman who was the 
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second to be selected: 


a: 
P (A|H;) = sim [1-—-(1—p;)?]+ >) a [1—(1— p;) (1 — p;)]. 
j#i 

3.13. A radar unit tracks a target which may use interference. If 
the target does not employ interference, then during one surveillance cy- 
cle the unit may detect it with probability py; ifit employs interference, 
then the unit may detect it with probability p, << py. The probability 
that the interference will be used in one cycle is p and does not depend 
on the way and time the interference was used in the other cycles. Find 
the probability that the target will be detected at least once in 7 sur- 
veillance cycles. 

Solution. The total probability that the target will be detected 
during one cycle is (1 — p) Po + pp;; the probability of at least one 
target detection in nm cycles is 1 — [1 — (1 — p) py — pp,”. 

3.14. A diagnostic apparatus is functioning, into which the results 
of n analyses taken from a patient are fed. Each analysis (independent- 
ly of the others) may prove to be erroneous with probability p. The 
probability # of a correct diagnosis is a nondecreasing function of the 
number m of correct analyses: # = ~ (m). During the time t of func- 
tioning of the apparatus diagnoses for k& patients were made. Find 
the probability of the event A = {an erroneous diagnosis was made 
for a certain patient}. 

Solution. We consider the event B = {an erroneous diagnosis was 
made for a certain patient}. We advance hypotheses concerning the 
number of correct analyses: 


H, = {not a single correct analysis} ; 


H, = {exactly one correct analysis}; 
A, = {exactly m correct analyses}; 
ff, = {n correct analyses}. 


The probability of the event H,, for any m can be calculated by 


formula (2.0.15) (the theorem on repetition of trials) when p is re- 
placed by 1 — p: 


P (H)) a p", P (H;) = it (4 a p)p”—,. 4 
Pm) = Co (lL — py™p"-™, ...,  P (A,) = (4 —p). 
By the total probability formula we have 
P (B) = 2 Cn (1— p)™ p"-"p(m), P(A) =1—[1—P (B)}*. 


3.15. Each article a factory pr 

3 ach ¢ a factory produces may have a defect with prob- 
eke Pe Tvach article is checked by a sorter who may detect a Fh ne 
uWoany, with probability p, or may not detect it with probability 
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{— p, In addition, the sorter may make a mistake and reject a sound 
article, this occurs with probability p, The sorter can check V articles 
during one shift Find the probability # that at least one article will be 
assessed incorrectly, 2e a sound one rejected as defective or a defective 
one passed as sound (the results of the checks of the articles are in 
dependent). 

Solution. The hypotheses are 


H, = {an article has a defect}, 
H, = {an article does not have a defect}. 


By the total probability formula, the probability of one article 
being assessed incorrectly 1s 


p=p(t—p) + (i —p) pe 
The probability that at least one article is assessed rncorrectly 13 
R=1—(d—pj 


3416 There are a2 students obtaining “excellent” marks, b students 
obtaming “good” marks and ¢ students obtaining “four” marks in a group 
In a forth coming examination, students that usually get excellent 
marks receive only “excellent” marks, those who usually get “good” 
marks may receive either “excellent” or “good” marks with equal prob 
abilities, and those who usually get “fair” marks may receive “good, 
“fate” or “poor” marks with equal probabilities At the examination 
a student is selected at random Find the probability of the event 
A = {the student receives a “good” or an “excellent” mark} 

Solution. The hypotheses are 


ff, = {a student who usually gets “evcellent” marks 1s 
selected}, 


H, = {a student who usually gets “good” marks 1s selected}, 
H, = {a student who usually gets “fair® marks ts selected} 


b 
P= seep PU =apepe > PU apETe 
D 
P(A)=PUH,) 14+P(H,) 14 P(H) >= SE 


3.17. The conditions are the same as in the preceding problem, 
but three students are selected at random Find the probability that 
they will receive an “excellent”, a “good”, and a “fair? mark (in any 
sequence), 

Solution. An event A = {an “excellent”, a “good” and a “fair” mark 
are obtained} 13 possible only for the following hypotheses: 


ii; = {one student who usually obtains “fair” marks, one 
student who usually obtains “good” marks and one student 
who usually obtains “excellent” marks are selected}, 
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H, = {one student who usually obtains “fair” marks and 
two students who usually obtain “good” marks are selected}; 


H, = {two students who usually obtain “fair” marks: 
and one student who usually obtains “good” marks are 
selected}; . 

H, = {two students who usually obtain “fair” marks and 
one student who usually obtains “excellent” marks 
are selected}. 


babe A Eoag 2 
PA) =WZwopw—D P(e) =F (V2) ” 
3be (ec —1) ___ 8ae (c—1) 
P (Hs)=—WW—D WD » PUN)= N (N—1) (N—2) ’ 
N=a+6-e. 


i 1 2 1 1 2 2 
P (A) = P (Ay) 1-5-3 +P (A) a+ P (As) + P(A,) Tg. 


3.18. Each of the m passengers sitting in a bus may alight from it at 
the next stop with probability p. Moreover, at the next stop either no 
passengers alight with probability p) or one passenger boards the bus 
with probability 1 — py. Find the probability that when the bus con- 
tinues on his way after the stop, there will again be m passengers in it. 

Solution. An event A = {there are again nm passengers in the bus 
after the stop}. 

The hypotheses are 


H, = {no passengers board the bus}; 
Hf, = { one passenger boards the bus}. 
P (Ho) = Po, P (Ay) =1—po, P(A | Ho) = (1 — pl’, 
P(A | Hy) = np (4 — p)’*, =P (A) = po  — p)” 
+ (lL — po) mp (1 — py. 


3.19. An instrument consists of two units I and II which repeat each 
other (Fig. 3.19) and can operate at random under one of the two sets of 
conditions: favourable or unfavourable. Under favourable conditions 
the reliability of each unit is p, and under the unfavourable conditions 


if is py. The probabilily that the instrument will 
operate under favourable conditions is P,; and under 
the unfavourable conditions 1 — P,. Find the total 
(average) reliability P of the instrument. 

Answer. 


P=Pyf1— (1 — pl +4 —P,) (4 — 1 — p,)1. 
3.20. There are instruments of the same kind on a Fig. 3.19 
shelf, among which there are a new instruments and 


b used instruments (a> 2, b> 2). Two i 
= 4, O24). lwo instruments are selected at 
random and used for some time. Then they are replaced onto the shelf. 
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Then again to instruments are selected atrandom Find the probabuity 
of the event A = {both tmstruments celected the second time 
ate new} 


Solution The hypotheses are 


H, = {both instruments selected the first time were 


new } 
H, = {both instruments selected the first time had been 
used} 
if, = {one of the instruments selected the frst time was 
new and the other had been used} 
¢ia—t) _ bfh-4) 
PUL) appa PV eet 
P (H,} ———_- ne 


(2 6) fat 6—4) 


t (A\ _7 {a— 1} (a——2) (a—d)+6 (—~ 1) a (a—1)+ 226 (a-—— 1} (a— 2} 
(a 6)? (e-+4—14)3 
321 A messagecan be sent over each of m communication channels 
each channel possesaing differant properties (ar being in different 
conditions), , of the channels are in excellent condition m, channels 
are in good condition , channels arte in fair condition and wy, are in 
poor condition {f, + fy + iy + Hy, — nm} The probability of a mies 
sage being transmitted correctly 1s equal to p, py Ps and p, for diflerent 
channels respectively Tao increase the relinhility of the traffic, each 
Message is repeated twice Over two different channels which are selected 
atrandom Find the probability that tt will be transmitted correctly at 
least over one channel 
Solution A = {at least one message is transmitted correctly} We 
adx ance four hypotheses concerning a group to which the channe! over 
Which the first of the tuo messages 15 sent belongs #, ff, As Hy 
where H, = {the first message 1s sent over a channel in the rth group}, 
P(H,) = nn (i= 1 2 3 4) By the total probability formula 
4 


P(A) = 2 P (HL) P(A|E,) 


On the hypothesis H, the conditional probability of the event A 1s 





P (Ap) = [1-1 J ~ ) 4-1 py) U— 
Pi 


322 An mistrument consists of two units I and II (Fig 3 22), both 
of which must be faultlees for the instrument to operate, and a voltage 
Stabilizer S which can he either sound or faulty When the stabilizer 
is sound, the reliabilities of units I and IT are p, and p,respectrvely when 
the stalbzlizer is faulty, they are p\ and p, The stabilizer is sound with 
probability pg Find the total reliability P of the instrument 
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Answer. 


P = DgPyP2 + (1 — Ps)PiP2- 
298 The conditions are the same as in Problem 3.22 but units 1] 
and II repeat each other (Fig. 3.23). 
Answer. 
P = pslt—(l — pi) (1 — pe) + (1 — ps) [1 — (1 — Py) 
x (1 — p,)). 
3.24. There are m test papers, each of which contains two questions. 


A student does not know the answers to all the 2n questions but only 
knows those to k << 2n questions. Find the probability p that he will 


“Lt 
ome 


Fig. 3.22 Fig. 3.23 


pass the test if he either answers both questions in one test paper chosen 


at random or one question in his paper and one question (which the 
examiner chooses) in another paper. 


Solution. The hypotheses are 
H, = {the student knows the answers to both questions 
on his paper}; 
H, = {the student knows the answer to one question 
out of the two questions on his paper}. 


__k(k—1) ee 2k(2n—k) k—1 
2n (2n—1) 2n(2n—1) 2n—2 ° 


3.29". An artillery target may be either at point I with probability Py 
or at point If with probability p, == 1 — p, (p, > 1/2). We have n 
shells, each of which can be fired at either point I or point IJ. Each shell 
may hil the target, independently of the other shells, with probability p.- 
How many shells x, must be fired at point I to hit the target with 
a maximum probability? 


Solution. The event 4 = {the target is hit when nm, shells are fired 
at point I}. The hypotheses are 


H, = {the target is at point J}; P(W4,)=p,: 
Hf, = {the target is at point IJ}; P(W,) = 1— De 
P()=p, 0 —(l—py™1+ 4 —p) Il — a — pra]. 
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Considering P (A) to be a function of the continuous argument Ry 
we find that 


Ot — py (1—p)™ + (1—p,) (4—p)” "Yn (t—p) 


any 
dipya nt " 
Se Tle py (1 pa (i ~ py" Yln2(t— py <0 
and see that the function possesses a single maximum at the point 


n, => +1n */12 in (1—p)] where dP (A}/dn, =0 





Note that Ny > nf2 for p, => 1/2 


lf the number obtained ny < m% and 1s an integer, then it is the re- 
quired number if rt ts not an integer (but <2”) then we have to caleu 
late P {A) for the two nearest integers and choose the integer for which 


P (A) is greater If the number H, 18 greater than nm then all x shells must 
be fired at pointI (this happens for Ini(l — pyV/p,l< nv In (1 — p) 
be pelt + (1 — py)? 

3 26 A plane is landing Ifthe weathers fay ourable the pilot landing 
the plane can see the runway In this case the probability of @ safe 
landing is p, If there 1s a low cloud ceiling the pilot has te make a blind 
landing by instruments The reliability (the probability of failure free 
functioning) of the instruments needed for a blind landing is P IE 
the blind landing instruments funetion normally the plane makes 
a sale landing with the same probability p, as in the case of a visual 
landing If the blind landing instruments fail then the pilot may make 
a sale landing with probability p* < p, 

Find the total Probability of a safe landing if it 1s known that 
In & per cent of cases there 1s a low cloud ceiling 

Solution A = {a safe landing} The hypotheses are 


Hy = {the cloud ceiling 1s high} 
H, = {the cloud ceiling is low} 
P(7,)=1-— ki100, P 3) = 4/100, P(A |.) =p, 
P (A | #,) can also be found by the total probability formula 


PIAL Hs) = Pryt(t~P) pt P(dy=(1—£) p, 


+ aay [Pry + (1 ~ P) pt] 
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Solution. We use Bayes’s formula (3.0.2) to solve the problem. The 
hypotheses are 


H, = {the first urn is chosen}; 
H, = {the second urn is chosen}; 
H, = {the third urn is chosen}. 


A priori (before the experiment) each hypothesis is equally possible: 
i.e. P (—H,) — P (H.) — Pp (3) — 1/3. 

The event A = {a white ball is drawn} occurred. We find the con- 
ditional probabilities: 

P(A|H,)=ala+b), P(A| Hs) =cle +4), P(A |H,) = 1. 


By Bayes’s formula, the a posteriori probability that the ball was 
drawn from the first urn is 


; 3 
P(H,|4)=4-P(A| Hy) /[ 4 2 Pal] 








Similarly 











P (HI A)=(s49)/ (aa * =a +1): 
Pls A= (sop tech + 4) 


3.28. An instrument consists of two units. Each unit must function 
for the instrument to operate. The reliability (the probability of failure- 
free performance for time t) of the first unit is p, and that of the second 
unit is py. The instrument is tested for a time ¢ and fails. Find the 
probability that only the first unit failed and the second unit is sound. 

Solution. Four hypotheses are possible before the experiment: 


H, = {both units are sound}; 
H, = {the first unit failed and the second one is sound}; 


H, = {the first unit is sound and the second one failed}; 
H, = {both units failed}. 


The probabilities of the hypotheses are 
P (Ho) = pypa,_ P (7;) = (1 — py)pe, P (72) = p, (1 — pa), 
P (H3) = (1 — py) (1 — po). 
The event A = {the instrument failed} occurred: 


P (4 | Hy) = 0, P(A |H,)=P(A |.) = P(A | #5) = 1. 
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By Bayess formula we have 
{1— py] Ps __ (L— py} Ps 
PMs | Ad = (1 Py) Pee py U— Pal tli py Pr) 

399 As for Problem 3 26 except that 1t is known that the plane land 
ed safely Find the probability that the pilot used the blind landing 
instruments 

Solution If the pilot landed blind, then the cloud ceiling was low 
(hypothesis #,) From Problem 3 26 we find that 


say tPP HAP) Pm 


ir 
(1-+5] pit aay [Pp +t —P) ptt 


330 A fsherman has three favourite places for fishing and he may 
visit each with equal probability If he casts a line at the first place 
the fish may bite with probabrlity p, at the second place with probe 
bility p, and at the third place with probability p, It 1s known that 
the fisherman cast a Ine for three times and that he got only one bite 
Find the probability that he fished at the first place 

Anew er 


P(H,| A= 


3 
PU, |] A)= [py (1 — py?) ay ppll—p.yP 


331 Each article a factory manufactures may have a defect with 
probability p Each article 1s checked on the assembly line by one of 
two sorters with equal probability The first sorter detects a defect with 
probibulity p, and the second with probability p, If an article 1s not 
rejected on the assembly line 1¢ passes to the quality control department 
where defects provided that they exist are detected with probability ps 
An article is known to be rejected Find the probability that ut sas re 
jected (1) by the first sorter (2) by the second sorter or (3) by the quality 
control department 

Solution Before the experrment four hypotheses are possible 


H, = {the article 18 not rejected} 
ff, = {the article is rejected by the first sorter} 
di, = {the «rtrele is rejected by the second sorter} 


Hy = {the article is rejected by the quality control 
department} 


The event A = {the article ys rejected} occurred We do not need 
the hypothesis Hy since P {A | H,) = Qj 


P (H,) = ppfl2 P(A) = ppf/2) P(A) = pli — {(p, + peV2lps 
Atter the experiment the probabilities of the hypotheses are 


P (#7, [| 4) =——-—_-__—*2 __ => 
( i 2Py-b Pi + P23 (’— P5) D(H, CA) 2Dy+ (Py t+ Pe} (1 — Ps) 


P (Hy | A}~ pg l2 — (p, + Palil2py + (pi + Pa) (1 — Bo)] 
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32. Three out of ten students taking a test are excellently pre- 
ao four are well prepared, two are adequately prepared one : poor- 
ly prepared. There are 20 questions on the test paper. A stu oes who ie 
excellently prepared can answer all 20 questions, a student who = W 
prepared can answer 16 questions, a student who was i ond pre- 
pared can answer 10 questions and the student who was poorly pre- 
pared can answer only five questions. A student was called at random 
and answered three arbitrarily chosen questions. Find the probability 
that the student was (1) excellently prepared, and (2) poorly prepared. 

Solution. The hypotheses are 


H, = {the student was excellently prepared}; 
H, = {the student was well prepared}; 

H, = {the student was adequately prepared}; 
H, = {the student was poorly prepared}. 


A priori: P (H,) = 0.3, P (Hy) = 0.4, P (Hs) = 0.2, P (Hy) = 0.1. 
The event A ue {the student answered three questions}. P/(A | H,)=1. 


16 15 44 

P(A | 1.) =-o9 jo 18 ad 0.491, 
10 9 8 
5 4 3 


A posteriori: 


0.3-4 , 
(1) P14) = Saar por oa 0.2 0105+01 0.009 © 9-98, 


(2) P (H, | A) =0.1-0.009/0.518 - 0.002. 


3.33. A radar unit picks up a mixture of a legitimate signal and 
noise with probability p, and noise alone with probability 1 — p. If 
a legitimate signal arrives with noise, then the unit registers the pres- 
ence of a signal with probability p,. If noise alone arrives, then the 
unit registers the presence of a signal with probability p,. The unit is 
known to have registered the presence of a signal. Find the probability 
that there was a legitimate signal. 

Answer. 


pp,/\pp, + ( — p)pyl. 


3.34, A passenger can buy a train ticket at one of three booking- 
offices. The probability that he buys a ticket at a booking-office depends 
on its location; the probabilities for the three are Px, Pe and ps respec- 
lively. The probability that all the tickets are sold by the time the 
passenger arrives is equal to P, for the first booking-office, to P, for the 
second, and to P, for the third. The passenger buys a ticket at a booking- 
office. Find the probability that it is the first one. 
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Ca a 


Solution 
Pij=p, PUds-—p, PU)=Pps Az fhe buys & tacael} 
P(A[H)=1—-P, P(A [| #,)=1~— 2, P(A] H3)=1-~?, 


p, (4— P35 
P(Hy| A) =F-G= pj yp Pe) Fes Pa) 


333 A missile is fired at a plane on which there are two targets 
and IJ (Fig 335) The probability of hitting target I 15 p, and that a 
hitting target IJ 1s p, It 1s known that target I wa 
Z not hit Find the probability that target IL was hu! 
Np Solution The hypotheses are 


77 H, = {target I is hit} 
YY H, = {target IT 1s hit} 
LLL if, = {neither target 15 bit} 
Pig $8 The event A = {target I 1s not hit} 
P(Hi=p, P(Ha)~p, Py} =1—(p, + Po) 
P(4|H}=6 P(AH)=-1 P(A, H)=1 
By Bayess formula we have 
P (H, | A) = pifip, + 1 —~ (Py + Po)l = Paf(t — Pa) 
The problem can also be solved without resort to Bayes s formula 
P (H, |A) = P (#,A)/P (A) — P (Hf,)/P (A) = pf — Pal 
336 Signals are sent with probabilities 0, @, @s under one of three 
sets of conditions R, H, A, under each set of conditions a signal may 
reach the destination undistorted by interference with probabilities 1 
Pe and pgs respectively Three sugnals were sent under one set of condttrons 
{it is not known which) and one of the signals was distorted Find the 


a posteriori probabilities that the signals were sent under the first, the 
second and the third set of canditions 


Solution The hypotheses are 
ff — {conditions #,} 
Hf, -- {conditions #,} 
H,= {conditions #,} 
The a prior probabilities are P (#,) = GO, P (#,) = @, P (#3) = 


a 
The event A — {one signal 1s distorted and the other two are not} 
P(A] Hi=Sp*(t—p)) (=i 2 3) 


a 
PAHi| A)= Qi —pdidy QuP}t — pp (GG=t 2 3) 
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937 The cause of a fatal air crash is being investigated, and four 
hypotheses are possible: H,, H,, H3, /Z,. Statistically P (H,) = 0.2, 
P (H,) = 0.4, P (3) = 0.3 and P (4) = 0.1. The event A = {fuel 
ignition} was found to have occurred. By the same statistics, the 
conditional probabilities for the event A, given the hypotheses #,, Hao, 
H,, H,, are P (A | H,) = 0.9, P(A | H,) =0, P (4 | 7.) = 0.2 and 
P(A | H,) = 0.3. Find the a posteriori probabilities for the hypotheses. 

Answer. 


P (H, | A) = 2/3, P (Hy | A) = 0, P (Hy | A) = 2/9, P (Hy | A) = 1/9. 


3.38. A target being tracked may be in one of two states: 7, and Hp. 
The a priori probabilities of these events are P (H,) = 0.3 and P (H,) = 
— (0.7. Two sources of information yield contradictory information 
concerning the state of the target. The first source reports that the target 
is in state H, and the second reports that it is in state H,. In general, 
the first source yields correct information about the state of the target 
in 90 per cent of cases and is erroneous in only 10 per cent of cases. The 
second source is less reliable, it yields correct information in 70 per 
cent of cases and is erroneous in 30 percent of cases. Analysing the 
information received, find the new (a posteriori) probabilities of states 
H, and Hg. 

Solution. The event A = {the first source reports H, and the second’ 
reports H,}. On the hypotheses H, and H, the conditional probabilities 
of this event are 


P (A | H,) = P {the first source sent correct information 
and the second was erroneous} = 0.9-0.3 = 0.27, 


P (A | H,) = P {the first source was erroneous and the second sent 
correct information} = 0.1-0.7 = 0.07. 


By Bayes’s formula we have 


0.3-0.27 


P (H, | A)=1—P (A, | A) = 0.377, 


3.39. Under the conditions of the preceding problem there are three 
equally reliable sources of information which yield correct information 
in 70 per cent of cases and are erroneous in 30 per cent of cases. Two 
sources report that the target is in state H, and one source reports that 
it isinstate H,. Find the a posteriori probabilities of the states H , and #,. 


Solution. A = {the first and the second sources report A 
third reports H,}. port 47, and the 


P(A | Hy) =0.7-0.7-0.3 =0.147 
P(A | H,)=0.3-0.3-0.7 =0,063 
7 0.3-0.447 

6—0575 
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1e after the expermment the hypotheses #, and ff, are equally pos 
sible 

940 Before the experiment, it 1s possible to make z mutually evxelu 
sive hypotheses which form a complete group ff; Ha, , Hy, each 
hypothesis having an A priort probability P (77,), P (@,), , P (H,) 
lt, became clear as 2 result of the expernment that one of the hypotheses 
from the group Hf, H, was the true one and the other hypotheses were 
smpesstble 1e H, -+ H, + + 4, = Qand #44, -+ += 
*& Find the a posterior: probabilities of the hypotheses , 


Solution The event observed in the experiment A = >) H, By 


Fat | 


Bayes s formula we have 
ft 
P(A yA) =P (HX PH) = 4, A) 


16 if it becomes apparent as a result of the experiment that only some of 
the hypotheses Hy, Hf, are possible and the others are not, then to 
obiain the a posteriori probabilities we must divide each of the a priori 
probabilities P (H,) P (H,)} EP (@,,) by thew sum 

34f Aninstrument consisting of two units [ and If 15 being test 
ed The reliabilities (the probabilities of failure free performance 
during time t) of unrts I and I] are known to be p, == 0 8 and p, = 09 
The units may far] independently of each other After the elapse of 
time tit was found that the instrument was not sound Taking this fact 
into account find the probabilities of the hypotheses 


H, = fonly the first unit 19 faulty}, 
Mf, = fonly the second unit 1s faulty}, 


if, = {both units are faulty} 

Solution Four hypotheses rather than three were possible beforejthe 
experiment, including H, = {both units are sound} The experiment 
shows that one of the hypotheses H, H, H, holds true A = HA, + 
Hf, + H, The a prior: probabilities of these hypotheses are 


a 
P(H3)=02 01=002, >; P(H,)—-028 


t=1 
The a posterior: probabilities are 
P (H, | A) = 0 18/0 18 0643 P (H, |] A) ~ 0 286 and 
P(H, | A} se 6 071 
$42 The instrument whose characteristics are given in Problem 3 41 
is tested durimg time t and is found to be faulty To locate the fault, 
the instrument 1s put through three tests 7,, T, and 7, The first two 


tests give positive results and the third test gives a negative result, 
ie the event # = {+ + —} occurs, where ‘ + signifies a positive 
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result and “—” signifies a negative result. The conditional probabilities 
of the positive result for each test 7;, T,, 13, given the hypotheses 
H,, Ho, Hs, are known; we designate them as p;;, where i 1s the number 
of the test and j is the number of the hypothesis: py, = 0.4, pis = 0.6, 
Pips = 9.9, Pa = 9.9, Pos = 0.4, Po3 = 0.6, Pa = 9.7, Pap = 0.6 
and p33 = 0.3. The results of the tests are independent. 

Indicate the most probable of the possible states of the instrument, for 
which purpose find the a posteriori probabilities of the hypotheses, given 
that the experiment yielded events.A and B (A = {the instrument is 
faulty} = H, + H, + 4s). a 

Solution. We take the data of the preceding problem as the a priori 
probabilities to estimate the results of the tests: 


P (H, | A) = 0.643, P (7, | A) = 0.286 and P (H, | A) = 0.071. 


We calculate the conditional probabilities of the event B given these 
hypotheses: 


P (B | Hy) = 0.4-0.6-0.1 = 0.024, P (B | Hz) =0.5-0.6-0.4 = 0,120, 
P (B | H;) = 0.7-0.6-0.7 = 0.294. 
By Bayes’s formula we have 


0.643 -0.024 _ 
P (Hs | A+ 8) = 7 673-p0d4-- 0.286 -0.120--0.071-0.294 ~ 0.298, 


P(H, | A-B) = 0.662, P(H, | A-B) ~ 0.040. 


The most probable state of the instrument is H,-= {only the second 
unit failed}. 

3.43. A collection of nm parts, any number of which may be defective, 
is chosen to manufacture an instrument. The parts are supplied by two 
factories I and IJ. The statistics show that the articles produced by fac- 
tory I may have a defect with probability p, and those by factory II 
With p.. The instrument is assembled from parts produced by the same 
factory. In the laboratory where the instrument is being assembed 
there are three boxes of parts, two of which contain parts from factory I 
and one contains parts from factory IJ. The box from which the articles 
are taken is selected at random. The assembled instrument is tested. 
If no less than m of the n parts are found to be defective, the instrument 
is rejected and it is reported as unsatisfactory to the manufacturer. 
The instrument was rejected by the quality control department. Find 
_ aaa that its condition is reported as unsatisfactory to fac- 

ory 


Solution. The hypotheses are 


H, == {the instrument was assembled from parts 
manufactured by factory I}; 


H, = {the instrument was assembled from parts 
manufactured by factory II}. 


The a priori probabilities are P (7;)= 2/3 and P (H2) = 1/3. 
Ge 
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The event A = {the instrument was rejected} = {no less than m 
articles out of the m were defective} occurred 
PA} H)— BD pi—pyr! PAH) = 2 pil — py 


i=m 


By Bayes’s formula the a posterior] probabilities arc 


Tl 


nal » pl (i—pyr' 





3 
P (ii, | A) — rt — il | 
{ 
= >, pi (L =~ py}? t+ =y > Ps (t—p,) 
i=l iT 


P(H,| A)=1—P (H, | A) 


3 44 There are two boxes with parts of the same type The first con 
tains @ sound parts and & defective ones and the second contains c sound 
parts and d defective ones A box 1s selected at random and one patt 
is drawn from it and 1s found to be sound Find the probability that the 
next part te be drawn fram the box will alse be sound 

Solution The hypotheses are 

H, = {the first hox was selected} 


H, = {the second box was selected} 


The event 4 = {a sound part was drawn first} 


P(H)=P(H)=42, PUI A=(so5)/(sat+seq)- 


at C 
Pe A)= (sea) / (ete tepa) 
The event B = {a sound part was drawn second} 
P(B | A) = P (H; | A) P (B | HA) + P (Ay | A) P (BY HA) 


Given that the first box was selected and a sound part was drawn from 
it, the conditional probability of drawing a second sound part is 


P (B | HA) = (@ — 1)/(a 4- b — 1), 


similarly P (8 | HA) ~ (¢ — ive + d — 1} 
Hence the required probability is 
_. | _2 ¢ 1 a(a—t) ¢(c-— 4) 
PBA) a+b 7 c-+d | {a -}-5} (a -4-b— 14) + (24-4) {e-+-d—}) 


© 45 There are three communication channels over which messages 
are sent at random (with equal probability over each channel} The 
probability of a message being distorted when it 1s sent over the first 
channel] 1g p, over the second channel, p, over the third channel, Ps 
A channel is selected and A messages are sent over it, none of which are 
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—— 


distorted. Find the probability that the (ck + 1)th message, sent over 
the same channel, will not be distorted. 
Solution. The hypotheses are 


H, = {the messages were sent over the first channel}; 

H, = {the messages were sent over the second channel}; 

H, = {the messages were sent over the third channel}. 
P(A| H,)=(4—p,)*, P(A| A.) =(1—p,)*,P (A] Hs) = (1— ps)" 


ee, | (2) Sz! |) | 
P(A) = Tepe 1 pa) lh 
(1—p)k (i=1, 2, 3). 


~~ (f—py)F-E (A — po)k-F (— pa) 


The event A = {k messages are not distorted} and B= {the (k-+1)th 
message is not distorted}. 


_ (1—pz)P** + (1 — pa)h* 4 (1 — pg) 
als a la (1 — py) + (1 — p)? + (1 — pg)h 

3.46. There are m batches of articles with N,, V.,..., N» articles 
in each batch. The ith batch contains n; defective articles and N; — ny 
sound ones (i = 1, 2, ..., m). A batch is selected at random and k 
articles from it are checked. They all prove to be sound. Find the 
probability that the next 1 articles taken from the same batch will also 
be sound. 

Sofution. The hypotheses H,, H,, ..., Hm, where H; = {the ith 
batch is selected} have equal a priori probabilities P (7;) = 
lim (i = 41, 2, .. 2, m). 

On the hypothesis H; the conditional probability of the observed 
event A = {all the & articles checked were sound} is 


P(A| H;)=Cy,-n,/Cy, (i= 1, 2, ..., m). (3.46.4) 
By Bayes’s formula the a posteriori probabilities of the hypotheses are 


P(H1| A) =P(A| Hid P(Al Hy) (i= 41,2, ..., m). (3.46.2) 


The probability of an event B = {the next J articles taken from the 
Same batch are sound} can be calculated from the total probability 
formula using the a posteriori probabilities given in (3.46.2): 


m 
P (B)= py P(H;|A) P(B|H;A), where 
‘E— 
P(B H. a N;—n;—k Ni ;—nj—k—1 
( | iA) Ni i—k Ns;—k—1 
Ni—nj—-k—I-+1 . 

: Sa =) = ae i= {, 2. ery my). (3.46.3) 
emark. Formulas (3.46.1) and (3.46.3) are valid only for ; < NV; — n; and 


ww A hy — BE th iti 
ities < 1 a) ase {these conditions are not satisfied, the corresponding probabil- 


CHAPTER 4 


Discrete Random Variables 


40 The concept of 4 random variable 1s one of the most significant in probabil 
ty theory A random variable isa variable which as a result of an etper:ment with 
a Tandom ovtcome asstimes a certam value Examples {1} an experiment. 13 to fire 
four shots ata target the random variable is a numberof its {pb} an experiment tg 
the operation of a computer the random variable is the time the computer oper 
ates until tt fails 

In the set theoretical rnterpretation of the fundamental concepts of probability 
theory which we have adopted a random variable X 194 function of an elementary 
event » X =— p(w) where o € 2 The value of that function depends on which 
elementary event @ occurs as a result of an experiment 

We shall denote random variables by capital letters and nonrandom yariables 
by small letters 

The law of probability distribution of a random variable 1s the rule used to find 
the probability of the cyent related {0 a random variable for instance the proba 
bility that the variable assumes a certain value or falls in a certayn interval If 
4a random variable X has a given distributicn law then itis said to have such and 
such a distribution 

The most peneral form of the distribution law is a distribution function which 


is the probability that a random yariable X assumes a value smaller than a given 
value zoié 


F (2) — P(X < 2} (40 1} 


The distribution fonction F {xr} for any random variahle possesses the following 
properties F( — co) =O, F( + o) — 1 the function F (zr) does not decrease 
with an iicrease in z The distributions of discrete random variables have a +ery 
simple form A random yariable is said to be discrete if it has a finite or countable set 
of possible yalues 

In the examples considered above the random variable X ie the number of 
hits out of four shots being fired is discrete and may take the values 0 1 2 3 4 
The <ecoad random variable 2? the time a computer operates until ats first failure 
is nondiscrete its possible values contintously fill a certain part of the abscissa 
axis and their set ys uncountable 

The simpest distribution for a discreta random variable X 19 an ordered sample 
or ordered serves which isa table whose top row contains al] the values af the random 





variable 2, ay i; in the ascending order and the bottom row contains the 
corresponding probabilities p, p, Py 
wt ay a 
- | | | | {40 2) 
t Pi fy ry i 
Py = { 


of an ordered sample (Fig 4 0 1) is hnown as a fre- 


F } of a discreta random yariable X is a discontinu 
402}, whose jumps correspond to the possible 
variable X and are equal to the probabilities py 
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Do, -.. Uf the3e values respectivelv; between the jurips the function F (c) remains 
constant. Ata point of discontinuity the function F (x) is equal to the value with 
which it approaches the point of discontinuity from the left (in Fig. 4.0.2 those 
values are shown by dots). The function F (z) is said to be “continuous on the left”, 
i.e. when it approaches any point from the left, it does not suffer discontinuity, but 
when it approaches the point from the right, it may become discontinuous. 

The probability that a random variable X falls on an interval from a@ to B (in- 
cluding a) is expressed in terms of a distribution function by the formula 


P {a< X < B} = F (p) — F (a), (4.0.3) 
or, in another notation, 
P {X € la, B)} = F (B) — F @), (4.0.4) 


where the'[’ sign signifies that the point a is included in the interval from @ to B 
and the‘)’ sign signifies that the point 6 is not included into it. 


F (x) 





Fig. 4.0.1 Fig. 4.0.2 
The mathematical expectation, or mean value, of a discrete random variable X 


9 the sum of the products of all its possible values x; and their probabilities p,, 
8. 


M [X] = 2» LiDje (4.0.5) 


A random variable may not have a mean value if this sum diver 
es. When the 
mean value of a random variable X has to be denoted by one "pre icon write 


M [X] = m,. 


- A centred random variable is the difference between the random variable X and 
S mean: 


& = X¥ — m,. (4.0.6) 


The variance of a random variable X is the mean val 
: ue of th ‘Or- 
fesponding centred random variable: © square of the cor 


Var [X] = M [X2]. (4.0.7) 
For a discrete random variable X the variance can be calculated by the formula 


Var [X]= (zz—7x)2 pje (4.0.8) 


For the variance of a rand i 
om variable X we shall also use a desi i 
s eslgnatio 
@ mean square deviation, or standard deviation, of a random = my ie 


square root of its variance: ariable X is the 
o [X] = o, =Y Var. 


| | 7 (4.0.9) 
(the arithmetic, or positive, value of the root is always implied) 
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The Eth moment about the origin of a randort variable A 13 the kth power mean 
value of that variable 

a, [X] = M [X4} {4 0 10) 

For a discrete random yanable X the first moment about the origin can be cal 
culated by the formula 


ay [X]= >) zz; (3011 
i 


The kth certral moment of a random varable 1s the Ath power mean 
value cf the corresponding centred value 


uy (X]= M [Na] (4 0 42) 


For a diecrete random variable X the central moment can be calculated by the for) 
muls 


Wy XJ 3) (z,—atx)* py (4 0 13) 
; 


The mean value of a random variable X 1s its frst moment about the orrgin and 
the variance 1s the second contro] moment 


MEX) = a,fX] Var[X) = un, [X] (4 0 14) 
Central moments ate expressed im terms of moments about the origin 
pa [LX] = ay [X]} — mb 
lg [X] = yg [X] —3m ic, [X] + 2m} (4.0 15) 


Of especial amportance rs the fret formula which expresse$ the vatiance in terms 
of the second moment about the ongin 


Var (X] = a, (X] — m? (+ 0 46) 

Or im ancther notation 
Var [X] = MX?) — aM {xXp, {4 0 1%) 
1@ ihe variance ls equal ta the mean value of the square of the Fandom Lariable minus 


the square of the mean 


The indicator of an event A 18a discrete randam variable / which possesses two 
possible values @ and 4 


The random variable 1s equal to 0 if the event A does net occur and to umity i 
tL Occurs 


_{ 0 for mA, 











U ex (4 0 18) 
1 for wéad 
The ordered sample of the indicator UV of an event 4 has the orm 
q | { 
glP 
where p 1s the probability of the event in the experiment and g = 1 — p 
The mean and the variance of the quantity U are 
M [ &7] =f and Var [it] = peg (4 {r 19} 


respectively 


in the theory of probability the use of the indicators of events substantially 
sitaplifies the solution of problems (see Chapter 7} 
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When calculating the characteristics of random variables, it is often convenient 
to use the formula for complete expectation: if n mutually exclusive hypotheses Hy, 
H, ..., H, can be made concerning the conditions of an experiment, then the complete 
expectation of the random variable X can be calculated by the formula 


M [x] = 5 P (H;) M [X [4], (4.0.20) 


i=1 


where M [ X | H;] is the conditional expectation of the variable X on the hypothe- 
sis ;. 

The formula for complete expectation can be employed in calculations of mo- 
ments ahout the origin of any order: 


an [X]= >) P(H;) M[X* Hj. (4.0.24) 


i=1 


In principle, this formula can also be used in calculating central moments of any 
order: 
Tr Ob 
Hy [X]= >) P(H,) M[X"| Hy], (4.0.22) 


i=1 


but it must be borne in mind that the quantity X in (4.0.22) must be calculated as 


X = X — m,,, where m, is the unconditional expectation of the random variable 
7 as age by formula (4.0.20), rather than the conditional expectation on the 
ypothesis 4;. 

a are several frequently encountered types of distributions of random 
variables. 

4, The binomial distribution. A random variable X is said to be binomially dis- 
tributed if it may take the values 0, 4, ..., m, ..., 2, and the respective probabilities 
are 


Py = P {X = m} = Ch pmgn-m, (4.0.23) 


Where O << p<1,q=i1-—pandm=(0,1,..., n. Distribution (4.0.23) depends. 
on the two parameters, p and n. 

From the theorem on repetition of trials [formula (2.0.15)] it follows that the 
number X of occurrences of an event in n independent trials has a binomial distribution. 
For the random variable X, which has a binomial distribution with parameters p 
and n, we have 


M[X] = np, Var [X] = npg, (4.0.24) 
Where g = 1 —p, 
2. The Poisson distribution. A discreteyrandom variable X has a Poisson distri- 


bution if its possible values are 0, 1, 2, ..., m, ..., and the probability of the event 
{X = m} is expressed by the formula 





™m 
Pm=P{X=m}= = e2@ (m=0, 4, 2, ...), (4.0.25} 


Where a > 0. The Poisson distribution depends on one parameter a. For 
1] S ( ition de ; a random 
variable X which has a Poisson distribution 


M [X] = Var [X] = a. (4.0.26) 
The Poisson distribution is the limit for a binomial distribution as p> 0 
and n —» oo, given that mp = a = const. We can use this distributio ‘ ke 


proximations when we have a large number of independent trials. in 
eee r¢ 


an event A occurs with small probability. = 


gs 
a 
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The Poisson distributions can also be used in the case of a number of points fal 
ling in a given region of space (one-dimensional two-dimensional or three-dimen 
sional) if the location of the points Im space is random and satisfies certain rest 
Frictions 

The one dimensional variant 13 encountered when [ows of avents are considered 
A flow af events or traffic 13 a sequence of homogeneons avents occurring one after 
another at random moments in time (for more detail sea Chapter {0 

The average number of events A occurring per unit time is known ag the intenstly 
ofthe flow The quantity 4 can be esther constant or variable 4 = A (2) 

A flow of events 1s satd to be without aftereffects if the probability of the number 
of events falling on an interval of time does not depend on the number of events 
falling on any other non overla pping interval 

A fow of events 13 ordinary 1f the probability ci two or more events OccurrTilg 
on anelementary mtersal At 13 negligibly small aa compared to the probabulity of 
the occurrence of just one event 

An ordinary flaw of events without an afterelfect 15 known ag a Poisson flow or 
traffic If certain events form a Po:sson flow then the number X of events falling 
On an arbitrary time interval (t, fg + +t} has a Poisson distribution 





Prt. 
P= = ea (m=0 1 2 ) (40 27) 


where a is the moan value of the number of points falling on the interval = 
fo+t 


A (i) dt and 4 (t) 1s the rttensity of the flow 


" If 4 == const’ then the Porsson flow 1s said to be a stationary or elementary 
flow of the Poisson type For an elementar; flow the number of events falling on 
an} time nterval of length t has a Poisson distribution with paramter a — At 

A random field of points 13 a collection of points randomly scattered over a plane 
{OT 1n space) 


The intensity (or density) of a field 4.15 the mean number of points which fall i 
a unit area {unit volume} 

A field of points 1s said to be of the Poisson type if it possesses the following prop- 
erties (1) the probability of a number of points falling in any region of a plane 
(space) 1s independent of the number of pointa falling in any other non-cverlapp 2g 
resign (2) the probability of two or more points failing in the elementary region 
AzAy 1s negligibly small as compared to the probability of one point falling am that 
region (the property of ordinariness) 


The number X of points in a Poisson field falling in any region J of a plans 
(space) has a Poisson distribution 


P= te (m=0 4} (4.0 28) 


where ais the mean value of the number of points falling in the region S Ii the 
intensity of the field A(z y) = A = const the field 1s said to be Romogencous {8 
property similar to the stationarmess of a flow) For a homogeneous field with m 
tensity 4 we have a = sk where 1s the area (,olume) of the region S Ifa field 


inhomogeneous then a = \ { A(c y) de dy (for a plane) and a = \ { { A(z oy aye 


S 
dz dy dz {for «pace) “ ‘8 
Vben doing problems related to a Poisson distribution 11 13 convenient to use 
am 77 at 
fables of the function P tm a) = —7e % (see Appendix 1) and KR (m a) = 2° i 
{see A 


pendix 2) The last function 1s the probability that the random variable 4; 
which has a Poisson distribution with parameter a assumeg a value not exceeding 
fi(m a) = P {XS m} 
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een er . Siacssuat nar 

3. A geometric distribution. A random variable X 1s said to have a geome 
distribution if its possible values are 0, 1, 2, ..., m, ... and the probabilities of these 
values are 


P,=g™ Ip (m=0, 1, 2, +--+), (4.0.29) 

where O<p<i1,qg=i1-—p. a 
For a eurucuce of values m, the probabilities P,, form an infinitely decreasing 
geometric progression with a common ratio q. In practical applications, geometric 
distributions are encountered when a number of independent trials are carried out 


to reach a result A; in each trial the result is achieved with probability p. The ran- 
dom variable X is the number of “useless” trials (till the first trial in which the event 


A occurs). 
The ordered series of the random variable X has the form 
p{ap|qp|... | gmp | ... 


The mean value of the random variable X, which has a geometric distribu- 
tion, is 


M [X] = a/p, (4.0.30) 
and its variance 15 


Var [X] = ol pi. (4.0.31) 


The random variable Y = X -++ 1 is often considered, which is the number of 
trials made till a result A is achieved, the successful trial inclusive. The ordered se- 
ties of the random variable Y has the form 


p| ap | @p| .-. [gmp]... 
M [Y] = 1/p; Var [Y] = g/p?. (4.0.33 


2 (4.0.32) 


We shall call the distribution of the random variable Y = X + 1 a geometric 
distribution beginning with unity. 


4. A hypergeometric distribution. A random variable X with possible values 
» 4, ..., m, ..., @ has a hypergeometric distribution with parameters n, a, b if 
Pm = P {X = m} = CRCE-™/C2, (m = 0, 4, «.., a)*). (4.0.34) 


A hypergeometric distribution occurs when there is an urn which contains g 
white and b black balls and 7x balls are drawn from it. The random variable X is 
ee ila of white balls drawn and its distribution is expressed by formula 

sVeut}. 


The mean of a random variable which has distribution (4.0.34) is 


M [X] = na/(a +- 3), (4.0.35) 
and its variance is 


: ys nab a a—i a 2 
Var I= +n (n — {) | oF att — (ar) i e (4.0.36) 





*) When formula (4,0.34) is used, we must assume that Ch = Oifr>k, 
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Problems and Exercises 


4.1. Construct the distribution function of the mdicator U of an event 
A whose probability 13 p 
Solution, 
O for r= 0, 
rejmrw<a le for O<2r< i, 
{f for zl, 
where gq = 1— p (ea Fug 41} 
4.2, A coin is tossed three trmes A random vamable X 1s the heads 
obtained Construct for at ({}ihe ordered semes (2} the frequency poly- 
gon (3) the distribution function Find M (XJ, Var [X] and oc, 


Pt 





’ 
(4) 
lig 43 Fig 42 


Solution. The variable X has a binomial distribution with parame- 
ters » = 3 and p = 1/2 The ordered series 1s 

ofif{2 [3 

1/8 | 3/8 | 3/8! 1/8 
The frequency polygon is shown in Fig 42a and the distribution 
lunction 18 Shown in Fig 4 26 

43 Considering a nonrandom variable a to be a special case of a ran- 
dom variable, construct for it (1) the ordered series, (2) the distribution 
function, (3} find its mean and variance 


Answer, (1) 2 ma , (2) the distribution function 1s shown in Fig 43, 


(3) Ml [a] = a, Var [a] = 0. 
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4.4. A constant nonrandom variable ais added to a random variable X. 
How does this affect the characteristics of the random variable: (4) the 
mean value; (2) the variance; (3) the mean square deviation; (4) the sec- 
ond moment about the origin? 

Answer. (1) A term a is added; (2) it does not change; (3) it does not 
change; (4) a term a” + 2am, isadded (since %,[X] = Var [X] + mz). 

4.5. A random variable X is multiplied by a. How does this affect its 
characteristics: (1) the mean value; (2) the variance; (3) the mean square 
deviation; (4) the second moment about the origin? 

Answer. (1) it is multiplied by a; (2) it.is multiplied by a*; (3) it is 
multiplied by | a |; (4) it is multiplied by a’. 

4.6. We toss acoin m times and consider arandom variable X whichis 
the number of heads obtained. Construct the ordered series of the ran- 
dom variable and find its characteristics, i.e. m,, Varxz, Ox, [lg [X]. 

Answer. 


; ee Re ot Oe 
(1/2)" | Ch A/a)" |... | CH 1/2)" |... | 1/2)" 
m,=n/2; Var,=n/4, 0,=Vn/2, wu,[X]=0 


(since the distribution is symmetric about m, = n/2). 

4.7. We carry out m independent trials in each of which an event A 
may occur with probability p. Write the ordered series of the random 
variable X which is the number of occurrences of the complementary 


event A in 7 trials, and find its mean and variance. 
Answer. 


0 | 1 | oak | m | aes | t 
p™ | Chap™1 |... | CRg™p™™ |... | gn |’ 


Where g = 1 — p; m, = ng; Var, = npq. 

4.8. We carry out nm independent trials, in each of which an event A 
may occur with probability p. We consider a random variable R which 
is the frequency of occurrence of the event A in 7 trials, i.e. the ratio 
of the number of occurrences of the event A in n trials to the total num- 
ber of trials n. Write the ordered series of the random variable and 
find its mean and variance. 

Answer. 


0 | 1/n | sate | min | re | { 
ici A ee Ad 
q” | Chpgr | ... | CRpmgr-m | 1] pa]? 


where q=1—~p, m, =p, Var, = pg/n. 

4.9%. We carry out n independent trials. The probability of occur- 
Tence of an event A is the same in all the trials and equal to p. Find 
the most probable number m* of the occurrences of the event A. 
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Solution. We find the condition for which m* = 0 If m* = 0, the: 
g’ => Chpg™-) or gi= np, whence p<ii/(n +t) If m* =n, ther 
p™ >> Chap", p >> ng, whence p > ni/(n + 1) 

Let ws consider the case shen 0 << m* << x, 1n this case two inequals 
ties must be simultaneously satished 


Cm pint gn~m a Cott ome gnomend, 
Cm pm gn-m > Cme-tnme—ign= mers 
Th 


These two inequalities are equivalent to the following inequalities 
(m* + qe (a —m*}p, (n— m* + ft) pp mg, 
whence m* must be an integer satisfying the inequalities 
(n+ ip—idm*st(n+ i)p 


It can be verified that this condition 18 also satisfied af p <t 4/(n + 4} 
(m* = 0} ar in another extreme case if p >> n/(n + 1) (n*® = 2) 
Since the right hand side exceeds the left hand side by unity, there 1s 
only one integer m* between them The only exception 1s the case when 
(7 + 1} p and (2 + 1) p — 1 are integers Then there are two very 1m- 
probable values {mn -+ 1) p and (n+ 1}p-—-1 H mp is an integer, 
then m* = np 

410. Two marksmen fire at two targets Each of them fires one shot 
at his target independently of the other marksman The probability of 
hitting the target is p, for the first marksman and p, for the second Two 
random variables are considered, viz X, the number of times the 
first marksman hits his target and X, the number of times the second 
inatksman bris the target and their difference Z = X, — X, Construct 
the ordered series of the random variable Zand find its characteristics iz 
and Varz 

Sonution The random vamable Z has three possible values —1, 0 
and +1 


P{Z= — A= P(X, 0} P(X, = +1} = gps, 
P{Z =O} =P {X,;=0}P {X, =0) 
+P {X,= 1} PX, = 1} = aude t+ PrP 
P{Z= 1} =P {X,=1} P{X,—0)} = pyg,, 


where g, = 1 —p,,¢d.2 =1— Ps 
The ordered series of the variable Z has the form 


—i} 0 ; 4 
fiPa 9192 PiP2 Pi 


m,={— 1) ¢9,p,.40 (qy¢, + DyP.) + Upp, = — Pet 1 py. = Pim Ps 
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We can find the variance in terms of the second moment about the 
origin [see (4.0.16)I: 
Oy [Z] = (—1)?+ Gy Pe + O** (9192 + P4Po) + 1+ D192 
= QyDo+ 2192 = P+ Pe 2PiDe 
Varz = G, [Z] — mz = Py-+ Pp —2P,P2— (P1— Po)” 
= D191 + Pode: 


4.41. Two shots are fired independently at a target. The probability 
of hitting the target on each shot is p. The following random varia- 
bles are considered: X, which is the difference between the number of 
hits and the number of misses; Y, which is the sum of the number of 
hits and the number of misses. Construct an ordered series for each of 
the random variables X and Y. Find their characteristics: m., Var,, My, 
Var,. 

Solution. The ordered series of the variable X has the form 


{—2} 0 | 2 
q | 2pq| Pp 
Mi, = —2q?-4+2p*=2(p—gq); %[X}=4(" +p’), 
Var, = G, [X] — mz = 8pq. 


, Where g=i—p. 








The variable Y is actually not random and has one value 2; its or- 
dered series is 


2 
be + m,=2; Var, = 0. 





4.12. We have n lamps at our disposal, each of which may have a de- 
fect with probability p. Alamp is screwed into a holder and the current. 
is switched on. A defective lamp immediately burns out and is replaced 
by another one. A random variable X, the number of lamps that must 
be tried, is considered. Construct its ordered series and find its mean 
value m,.. 


Solution, The ordered series of the variable X has the form 








A) Ka at a in) OS ace ee ee 
q{ pa | pa]... | pte |... | pre |’ 
- (4.12.4) 
a= 3) twig pnp tag 2 (PIP) tyes 
i=1 


4.13. A random variable X has a Poisson distribution with mean 
Value a = 8. Construct the frequency polygon and the distribution 
function of the random variable X. Find the probability that (1) the 
Tandom variable X will assume a value smaller than its mean: (2) the 
random variable X will assume a positive value. 
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Answer (1) 0 423 (2) 0 960 

414 When a computer 1s operating 1f fails (goes down) from time 
to tune The faults can be considered to occur 1n an elementary flow 
The average number of farlures per day 1s 1 5 

Find the probabilities of the following events 


A — {the computer does not go down for two days} 
8 — {it goes down at least once dunng a day} 
C = {it goes down no less than three times during a week} 


Answer P({A)-0050 P(B)=0777 P(C) = 0 998 

415 Ashell landing and exploding at a certain position covers the 
target by a homogeneous Poisson field of splinters with intensity’ = 25 
splinters per sq metre The area of the projection of the target onto the 
plane on which the field of splinters falls is § — 08 m? If a splinter 
hits the target it destroys it completely and for certain Find the proba 
bility that the target will be destroyed 

Answer 0 865 

416 The same problem but each splinter hitting the target may 
destroy 1t with probability 06 

Solution We consider a field of affecting splinters with density 
A* = (06% = 15 splinters per sq metre rather than the assigned field 
ofsplinters The mean value of the number of affecting splinters hitting 
the target 1s a* = A"S = 1 2 splinters hence the probability of de 
struction A, =if—-e"™ =—1—O 350i = 0699 

447 A vacuum valve operates without a farure for a random time 7 
When it fails it 1s immediately replaced by a new one The flow of 
failuresis elementary and has intensity 1 Find the probability of A = 
{the valve will not be replaced during the time t} B = {the valve 
will be replaced three times} and C {= the valve will be replaced no 
leas than three times} 

Solution The mean value of the number of failures X during the 
fime 713 2 = [At 


P(A)=Py=e Ht P(B)— Pye got 


PC) =1— (yt Pyt Po}—l—e Mi —pt—0 5 (pty) 


418 A device consists of three units the first of which contains ™% 
elements the second n, elements ar the third nr, elements The 
first unit 1s obviously necessary for the device to function the second 
and the third units repeat each other The flows of failures of the ele 
ments are elementary For the elements of the first unit the intensity of 
Wits Brow vi feats “ny Wolre fur tue Yommates Vite seu wt til 
units itis 4, The first unit faits 1f no less than two elements far! The 
second unit (as well as the repeating third unit) fails if at least one ele 
ment fails For the whole device to farl it 19 sufficient for the first unit 
to fail or for both the second and third units to fall Find the probabili 
ty that the device will fail during the time + 
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Solution. The probabilities that one element from the first, the second 
or the third unit will fail during the time T are 


pp=i—emt and py=ps=1—e% 


respectively. The probability that the first unit will fail during the 
time T Is 


Pf, =1— (1 — py)" — mp, 1 — py)". 
The probabilities that the second and the third unit will fail are 
£, = 1— (1 — pe)” and =#,=1— (1 — pg,)”s. 
The probability that the whole device will fail is 
P =P, + (1L— £1) Po Po 


4.149. An earth satellite, orbitting for nm days, may collide with 
a meteorite at random. The meteorites which cut the orbit and collide 
with the satellite form a stationary Poisson flow with intensity x (mete- 
orites a day). A meteorite which hits the satellite may hole its shell 
with probability p,. A meteorite which holes the shell disables some of 
the instruments in the satellite with probability p,. Find the proba- 
bilities of 


A = {during the time of orbitting the shell of the 
satellite will be holed}; 


B = {the instruments will fail during the orbitting of 
the satellite}; 


C = {during the orbitting of the satellite only its 
shell will be holed but the instruments will not be 
disabled}. 


Solution. The mean value of the number of meteorites which hole 
the shell a, = xnp,. The mean value of the number of meteorites which 
hole the shell and damage the instruments a, = xnp,po. 


P(A) =1—e-40o=41—er-*"P0,  P (B)=t—er-1= 4—e- “nrpor1, 
P(C) = P (A) — P (B) = e7*%2Pop1 — e-*po, 


4.20. A group of hunters have gathered to hunt a wolf and set off 
forming a random chain that can be described as an elementary flow of 
points with intensity A on the z-axis (A hunters per unit length, see 
Fig. 4.20). The wolf runs at right angles to the chain. A hunter ‘fires 
a shot at the wolf only if the wolf runs at a distance no larger than R 
from him and, having fired a shot, may kill it with probability D. 
Find the probability that the wolf will be killed if the animal does not 
know where the hunters are and the chain is long enough for the wolf 
not to be able to run beyond it. ° 
_ Solution. If the wolfruns in the direction indicated by the arrow, it 
is fired at if at least one hunter gets into a strip 2R, wide connected with 
70575 
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the path of the wolf's displacement Evers hunter who fires at the wolf 
may be successful,1e kall the wolf with probability p Let us pass from 
the chain of hunters which has intensity } to the “chain of successful 
hunters” which has intensity 24* = Ap The wolf will be killed i at 
least one successful hunter gets into a strip 2A, long thrown at random 
enta the abscissa axis The pro 
bability of this ts 


P (A) = 1—e7 280m 


421. A car 1s subjected to 

an inspection and maintenance 

The number of faults detected 

A ; during the inspectron has a 

Poisson distribution with para 

meter a Jf no faults are detect- 

Fig 420 ed, the matntenance lasts for 

an average of two hours If one 

or two faults are detected, 

another half hour 1s spent elhmuonating each defect Ji more than two 

faults are detected the car takes four hours on the average to ber- 

pared Find the distribution of the average time 7 of maintenance and 
tena of the car and us mean value Af (T] 

Solution, 


2Rp 


Ps 
~[2t2s} 3} 6 
pa 


1 
ae7G a = q 
3 2 








{ena (1+0+<-} 





A iTj=e « (2+ 2.52 +> a)+6 | 1—e=* (1+a+4) | 
= 6—e%(443 5a+1 52%). 


4.22", A group of anrmalsisexamined by a vet and each may be found 
to be sick with probability p The examination procedure involves 3 
blood test on a sample blood taken from nm animals and mixed The 
Taixture will yield abnormal test results :f at least one of the m anzmals 
is sick A large number AN of animals must be examined Two methods of 
exrammation are suggested 

(4) all Wo animals are examined, in which case N blood tests must 
he made, 

{2) groups of animals are examined, first mixivg the blood of m an: 
mals If the test yields normal results, then all the animals in the 
group are considered healthy and the next m animals are examined Hf 
the results are abnormal, each of the n animals is examined and then the 
next group of animals is examined (nm >> 1}. 

Find which of the methods 1s more advantageous in the sense of the 
Minimum average number of tests Find nm - n* at which the minimum 
average number of tests 1s needed to examine the animals 

Solution, A random variable X,, which is the number of tests needed 
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for a group of m animals examined by the second method, has the fol- 
lowing ordered series: 


Th * 








The average number of tests for a group of m animals examined by the 
second method is 


M(Xq] = q" + (w+ 4) (1 — gt) =n + (1 — nq"). 


When the first method is used, » tests are needed for 7 animals. For 
ng? <1 the first method is, evidently, more advantageous than the 
second, while for ng” >> 1 the second method is preferable. 

Let us find the g for which the second method becomes more advanta- 
geous. What then is the optimal value n = n*? It follows from the 


inequality ng” > 1 that g > 41/7/n and hence that g > 0.694 since the 


minimum of 41/%/ n for an integer n is attained at n = 3. Let us assume 
that g > 0.694 and find the value nm = n* for which the average number 
of tests per animal is a minimum: 


R, = MIX, J/n = 1 — g® + 4/n. 
We must find the least positive root of the equation 
dR,/dn = — ging — 1/n? = 0, 


and having done so take the two closest integers, substitute them 
into the formula for R, and then choose the optimal n*. By using the 
substitution —In ¢g= a, an =z, the equation —g" Ing = 4/n? can 
be reduced to an equation ze = a (a = — Ing < In 3/3 = 0,366). 
For small values of a (and, hence, for small p = 1 — q) the last equa- 
tion hasasolution z ~ Va, whence n* ~ 1/V a. If the values of a are 
not small, then a direct comparison of the quantities R,, R, and R 
shows that R; is always smaller than R, and that R; < R, for 0.694 < 
q< 0.876; consequently, for 0.694 < g< 0.876 the optimal n* = 
3. We can show that for g > 0.889 (p< 0.411) the formula n* w 
1/Vp + 0.5 is a close approximation. 

4,23. A number of trials are made to switch on an engine. Each trial 
may be successful (the engine is switched on), independently of the 
other trials, with probability p = 0.6. Each trial lasts for a time 4 


Find the distribution of the total time 7 which will be needed to switch 
on the engine, its mean value and variance. 


distribution beginning with unity 0.32) cab gee ae seometzio 
tribution 

t | 2c | oe | eee | Me Isa. 

plap|a@p|... [ampli i...’ 
M(T]=tM[X]=+t/p, Var[T]=+2 Var [A] = t?g/p2 (q= 4—p). 


i* 
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4 24 Under the conditions of the preceding problem the trials are 
dependent and p; 1s the probability that the engine can be switched on 
after : — 1 unsuccessful trials, p,; being a function of z,1e p; = ¢ {2) 
Find the distribution of the random vartable T = TX 

Answer 
t | ar} 3t | J omr | 


m—/ 
at GiPm 
i—| 


r 


Pi | @iP2 | S19oPs 

















where g; = 1 — p,; 

425 When a relinble instrument consisting of homogeneous parts 
is assembled, each part is subjected to 1 thorough inspection as a result 
of which it 1s eather found to be sound (with probability p) or is reyectec 
{with probability g = 1 — p) The classification of each part 1s inde 
pendent The store of pirts 1s practically unlimited The selection o. 
parts and their inspection go on until & high quality parts are selected 
A random variable X 1s the number of rejected parts Find the distrs 
bution of the random variable ¥ P,, = P {X = m} 

Solution The possible values of the random variable X are O 1 
Hy We find their probabilttres 


P, = P ithe first & parts are sound} = p* 

P, = P fone part out of the first 4 is rejected the 
(A + 1)th part 13 sound} = Chq'p* 'p = 
Chq'p* 


P,, = P {mm parts out of the first A +- m — 1 parts are 
rejected the (m+ Ath part is sound} = 
Chtmad Pp (m=1 2 ) 
426 Two random variables X and ¥ mav be either 0 or 4 mdepend 
ently of each other Ther ordered series are 


0 | 4 att 

qx | Px gy | Py 
Construct the ordered series ({} of thetrr sum Z = X + Y, (2) of their 
difference 7 = X — Y, (3) or their product V — XY 


Solution (1) The random variable Z has three possible values 
0, £f and 2 


x 

















P{Z=0}=P{A =0, ¥=0} =9,¢, 
P{Z=1}=P{A=1 F=O0}4+P{X¥=0, Y=1} 


= Pedy + Fe By 
P{Z=2}=P{X¥=1 Y=1} pp, 
O | : | 2 


Z 
GxTy | Pry T U2 Py | Pxby 
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By analogy we find that 








—4 | 0 | 4 
UT. | ————$——————___—_— 
QxPy | PxPy+4xy | Pxdy 

0 i 4 





° 








xeIy tt PxIy + OxPy | PxPy 


4.27. A random variable X has an ordered series 
1 | 2 | 4 
0.5 | 0.2 | 0.3 








Construct the ordered series of the random variable Y = 41/(3 — X). 
Answer. 


—1|05| 4 
0.3 | 0.5] 0.2 








4.28. A random variable X has an ordered series 
—2{-—1] 0 | 4 | 2 | 
0.2 [03 [02] 0.2 {04 |" 


Construct the ordered series of its square: Y = X°*. 
Answer, 





o | 4 | 4 


Y: |——_____- 
0.2 | 0.5 | 0.3 








4.29. When a message is sent over a communication channel, noise 
hinders the decoding of the message. It may be impossible to decode 
the message with probability p. The message is repeated until it is 
decoded. The duration of the transmission of a massage is 2 min. Find: 
(1) the mean value of the time 7 needed for the transmission of the 
message; (2) the probability that the transmission of the message will 
take a time exceeding the time t, at our disposal. 

Solution. ({) The random variable X, the number of trials to send 
a message, has a geometric distribution beginning with unity; T = 
2X min. The ordered series 7 of the random variable is 


2[ 4] 6]...] am |... 
q| pa| pq]... | pmtg|... 
(2) PT>t)= So pmtgeg Spm 
o wes ' Y cteniui® an 


where [t,/2] is the largest integer in t,/2. Summi 
progression (4.29), we obtain 0 ming up the geometric 


P{T>1t}= 
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430 A discrete random variable X has an ordered series 


| te] | Tr 
Pil Pel | Pr 


A random variable Z is the minimum value of two numbers—the value 
of the random variable ¥ and the number a 1e Z = min {X @} 
where z,)<< as<z, Find the ordered series of the random variable 2 
Solution By definition 
z | X for X<ea 


for A™>a 








The ordered serres of the random variable Z coincides with that ol 
the random variable X for the values z, x, which are smaller 


than or equal to a P {Z — a} can be calculated as unity manus the 
sum of all the other probabilittes 


P{zZ=a}=1— s) Pr 

x jSRa 
431 The ordered senes of a discrete random variable X 15 
t|3j),5}]7]9 
01]02/0 3/0 3/04 


Find the ordered sertes of the random varrable Z = min {X 4} 


h Answer Proceeding from ihe solution of the preceding problem %& 
ave 








1{3|4 
04/0 2}07 








432 Two random variables X and Y wmdéependently of each other 
assume 4 value according to the following ordered series 


O,4[2 | 3 1([3 [4 














Construct tle ordered sertes of the randam varmble Z = min {A4, Y} 
Solutron 


P{Z=0)=P{¥=0}—-0 2 
P{Z=4}=P{X=1IS+R(Y =i Xm ip=03407 05=0 55 
P{Z 2} P{X-—2 Yw2}-04 03-012 
P{Z=3}=—=P{X 3 Yord}-oO1 03-003 

O|[1i|]2 {3 

0 20/0 65/6 12]0 03 
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4.33. Under the conditions of the preceding problem, find the ordered 
series of the random variable U = max {X, Y 
Answer. 


{2t213 4] 4 
" 10.85 {0.28 (0.27[0.10]” 


4.34. Ann-digit binary number is written in a computer cell and each 
sign of the number assumes the value 0 or 4 with equal probability 
independently of the other signs. The random variable X is the number 
of signs “1” in the notation of the binary number. Find the probabilities 
of the events {X = m}, {Xm}, {X < m}. 

Solution. The random variable X has a binomial distribution with 
parameters n, p= 1/2, P {X =m} = CF (L/2)", 

P(X >m} = (4/2)” 2 C™, P{X<m}=1—P{(X>m}. 
=m 

4.35. A proper three-place decimal fraction X is considered, each 
sign of which may assume each of the values 0,1, ..., 9 with equal 
probability independently of the other signs. Construct the ordered 
series of the random variable X and find its mean value. 

Solution. The possible values of the random variable X are 0.000, 
0.001, 0.002, ..., 0.999. The probability of each of them is p = 


(0.1)? = 0.001. The ordered series of the random variable X has 
the form 


— [0.000 {0.004 | 0.002] ... [0.999 
~ {0.001 {0.001 /0.004/ ... {0.004 


999 $99 
M([X] = py t;p; = 0.004 pa} x;, Where a; t-0.001. 


The numbers x; form an arithmetic progression consisting of 1000 terms 
With a common difference 0.001. Summing up the progression, we obtain 


M [X] =2£2"". 1000.0.004 = 0.4995 ~ 0.5. 


4.36. A random variable Y is a random proper binary fraction with n 
decimal places. Each sign, independently of the other Signs, may be 
either 0 or | with probability 1/2. Find the ordered series of the random 
variable Y and its mean value M [Y]. 

Solution. As in the preceding problem, all the values of the binary 
number from 0.00 ...0 to 0.11... { are equally probable and each of 
them has a probability 1/2". The mean value of the random variable ¥ 
(in the decimal notation) M [Y] = 0.5—1/2"+1, 

4.37. A message is sent over a communication channel in the binary 
code and consists of a sequence of symbols 0 and 1, alternating with an 
equal probability and independently of each other, say, 0, 0, 1, 1, 4, 0 
1.1, 1,0,0,0,0,1,0,1,1,1,.... oa 
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A run of the same symbols 1s considered, say, 0 0,0 ori 4,4 1 (or 
simply 0 or 4 af the symbols are not repeated} Any one of these runs 
taken at random A random variable X 1s the number of symbols in 
arun Find its ordered serres mean value and variance Find P{X > 4} 

Solution The random variable X has a geometric distribution begin 
ning with unity 


1} 2 {| 


———— ————}, XJ = 1/05 = 2 
O5/05%{ [05 | 


Var[X])=05/05?=2 P{XiA}= + 05"=0.5'-5 


moth 


438 Under the conditions of the preceding problem P { 0°} =07 
Pie’) =03 Find the average number af symbols MUX] tm a run 
of zeroes the a\erage number of symbols M[Y] in a run of unities and 
the overall average number of symbols M [Z] in a run of symbols chosen 
at random Find the variances Var {AJ Var {¥} Var [2] 

Solution M(X] — 1/07 — 10/7 M[¥l = 1/03 — 10/3 By the 


n iv 
formula for the complete expectation we find that WIZ] = 0 j at 


03 7s 2 1e the same asin the preceding problem Var lX] = 
O 3/0 7? = O6f2 Var [¥Y] = 07/0 3? = 7 778 

To find Var (Z} we first find a,/Z) “0(Z?] by the formula for the 
complete expectation {see (4 0 20)] *) 
a, (Zj=6 7a, 1X} +03, /Y] where a, lA] = Var iXi4+ (tah 
266 a,[¥) ~ Var [¥] + (MI[Y])’ ©189 then a, [Z] x7 33 
Var (Z) — a, [ 2) — (MIZIY ©2353 1e the last variance 13 larger 
than that in the preceding problem 

The probability P {X >> A} can be found by the total probability 


formula with hypotheses #7, = {the first symbol is 0} A, = {the 
first symbol is 1 } 


P (Ho) = 07, P (Ay) —03 P{XDA!H,} = O7* } 
P {Xk [ AY} = 03 1, then P {X ok} ~ 07078 3 
+03 03%-t—07' +034 


439 A device consists of m untts of type I and x units of type I 
The reliability (a failure free performance for an assigned time 1} of 
each type I unit is p, and that of a type II unit is p, The units fall 
independently of one another For the device to operate any two type 
units and any two type I] units must operate simultaneously for trme 7 
Find the probability # of the failure free operation of the device 





*) By the formula for the complete expectation we seek the second moment 
about the origin rather than the vatiance rt+ell (nce conditional expectations 
are different for different hypotheses) 
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Solution. The event A = {failure-free operation of the device} is 
a product of two events: 


A, = {no less than two out of m type I units operate 
without failure}; 


A, = {no less than two out of n type IJ units operate 
without failure}. 


The number X, of type I units operating without failure is a random 
variable distributed according to the binomial law with parameters m 
and p,; the event A, corresponds to the random variable A, assuming 
a value no smaller than 2. Therefore 


P (4,) = P {X,> 2} = 1 — P {X, < 2} 
=1—P {X, =0}—P {X,=1) 
= 1 — @? + mq?-'p,) G@ = 1 — Py). 


Similarly, P (A.) = 1 — (q? + ng®-!p.) (dg = 1 — Po). 
The probability of a failure-free performance of the device 


Ff = P(A)=P (Ay) P (Ag) = 11 — (9? 4+ mg?-p,)] 11 — (g§+-nge- 'pe))- 


4.40. An instrument is used (activated) several times before it fails 
(an instrument that has failed is not repaired). The probability that 


PUK 


> sa =5 
0 / Z 3 K / 2 i ere a eae 4 
Fig. 4.40 Fig. 4.44 


having been used / times an instrument does not fail is P (k). The func- 
tion P (k) is given (see Fig. 4.40). The instrument is known to have 
been activated n times. Find the probability Q,, that it can be activat- 
ed another m times and the mean value of the number X of future 
activations. 

Solution. Q, is the conditional probability that the instrument 
Will not fail when activated the next m times provided that it has not 
failed the first 2 times. By multiplication rule for probabilities P (77 + 
m) = P (n) Q,,, whence 





P (n-++-m) ~ 
a Pin » M [A] = > MOQ m: 


Mz { 
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441 A worker operates mn machine tools of the Same type which are 
located along a straught line with intervals £ (Fig 441) From time te 
time the tools stop (with equal probability and idependently of one 
another) and must be adjusted Having adjusted one tool the worker 
stays put until another tool stops then he goes tc that tool (:f the same 
tool fails he stays put) A random varrabla X 35 the distance the 
worker covers between two adjustments Find the mean value of the 
random tariable A 

Solution We apply the complete expectation formula with hypothe 


sis H, — {the worker stays at the tth tool} (i = 1, n) According 
to the conditions of the problem all the hypotheses are equally prob 
able FP (#,) = P (#,) — —~ P(H,) = i/n Let us find the 


conditional expectition M {X21 for the ith hypathests Each tool 
dtth inclusive) stops with probability i/n hencé 


1 ul 
f 
M[X |] =f + G—-A+ > (k—i) |= 5, [e(t— 4} 
ko] A=t 
Fe Qa YH Uo NY 
By the contplete expectation formula 


it 


M{X}= >) PCH) MIX] Hl = SSE I ln) (eet 





i i=4 
~ 38 | >; c(t—1}+ Dy (n—~2+1)(n—1)| (4 41) 
t-1 ix 
Using the famuiltar formula >, 2, a tee YY we calculate 
a1 
5 rg — 4) — RD Cr tt) a(atty RATT? 
7 6 > = 3 


1=1 


Using this formula to calculate both sums m1 (441) we make sure 
that the, are equal and 


Tl 
i i — 1} i(n®— 1} 
M{Xj=—> 5} (it) ng RETO = 
i=i 
442 A number of independent trials are wade in each of which 
an event A may occur with probability p the trials are continued until 
the event A occurs after which they are termmated A random varia 
ble A is the number of trials Construct its ordered series and frequency 
polygon derive formulas for ts mean value variance and mean square 
deviation 
Solution The random variable X has a geometric distribution 
beginning with units [see (4 0 32)] The ordered Series of the variable X 
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has the form 


p| ap |p| ...[g@Ip!... 


where g = 1—p. The frequency polygon for p = 0.6 is shown in 
Fig. 4.42. 


OO 


MX] = x, mg™-1p = p yy mg™—!, 
m= 


mo 


We note that mg™-} is the derivative of g” with respect to q, hence 


co oo 


oO 
d d 
Di mgn-t= age ag at 
m= 


m=] m=1 


The last sum is the sum of the terms of an infinitely decreasing geomet- 
ric progression with a common 
ratio g; summing it up, we find 
that 


oO 


d q 1 
2» oe dq (745)= (1—q)* ’ 
m==] 


(4.42) 


whence M [X] = p/(1 —q)? = 1/p. 

The variance of the random 
variable X can be found in terms 
of its second moment about the 
origin 





a, {X]} = M[X?] = Xi, m2gm—-1np, Fig. 4.42 
m= 
To calculate it, we multiply series (4.42) by g, whence we get 
m q 
21 mg" = ae 
m=} 


Differentiating the series, we obtain 


a, =) 





NX mgmt — i-q 
ae 


Multiplying this expression by p= 1— gq, we get M[X2] = (4 + 
g)/(1 — q)*. The variance of the random variable X is [see (4.0.17)] 


Var [A] = M [X?] —(M [X])? = (4+ g)/(1 —g)®— 1/(4 — 9)? = g/p?, 
o,=V Var[X]=V q/p. 
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Thus, for a geometric distribution! beginning with unity 
M[X]=t/p, Var[X]=q/p?, o=Va/p 


The random variable ¥ = X¥ — 4, which has a geometric distribu 
lion beginning with a zero, possesses the characteristics 


MI[YJ=M[X}—1=:q/p,  Var{¥}= Var{X]=¢/p?, o,=)4/p 


4.43. Several trials are needed to tune up an intricate electronic 
circuit The probability that the circuit will be tuned in the first trial 
1s P|, in the second P, , Inthe Ath trial P,, The probabilities 
P, P,, I, ,P, are given After the nth unsuccessful trial to 
tune up the circuit, the trials are termimated Find the mean value and 
the variance of the randem variable ¥Y, which is the total number 
cf trials 

Solution The ordered series of the random variable X has the form 


y tl? tei [2 
* ' 
Pi|P.| [pl f1—Nertp, 





M {Xj = Dat P, +n [1— Sz! py, 
Var [A] = M[X?]—(M[X)?—= Sto! 2p. 4 n2{4. rc Py] —~ (MEX) 
444 An instrument 1s assembled from A types of parts meluding m 
parts of type : (z = 1, , A} (yy it, =m, m being the total 


i=j 
number of parts) The probability that a part of type z taken at random 
has a defect is g, The instrument operates only when none of the parts 
are defective (1) Find the probability P that the instrument will operate, 
(2) find the Probability A, that there will be no less than two defec 
tive parts in the instrument 
Solution (1) P is the probability that in m independent trials the 


h 
event A = {a part 15 defective} will not occur P= I} (—¢,)"™= 


Py, (2) H,=1—(P,+P,) where P, 1s the probability that none of 
the m parts are defective, P, 1s the probahbtlity that there 1s exactly 
one defective part P, can he found as the sum of probabilities that 
there is exactly one defective part among the m, parts of type 1, the 
other parts being sound, re 


P, —= ft; (tf — 9," “it a (1 — gy)" s 


+ M292 (1—9,)""~? I] (f—gjy"s + 
Jee 


i 
=> Mig (1—9g,)™ ' I (f—9,)"s 
t—1 jy1 
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4.45. A total of & messages are sent over a communication channel 
which contain 7,, 7%, ..-, %, binary symbols (0 or 1) respectively. 
The symbols assume the values 0 and 1 independently of one another 
with probability 0.5. Each symbol may be distorted (replaced by the 
opposite value) with probability p. When the messages are coded, a code 
is used which can correct errors in one or two symbols (practically 
with a complete trustworthiness). An error in at least one symbol (after 
the correction) makes the whole message erroneous. Find the proba- 
bility 2 that at least one of the & messages will be erroneous. 

Solution. The random variable X,; defined as the number of incor- 
rect symbols in the ith message, has a binomial distribution (4.0.23) 
with parameters n; and p. The probability that the ith message is erro- 
neous is equal to the probability that no less than three symbols of the 7; 
symbols in the message are incorrect: 

2 


P{X;>3} = 1—P{X;<3}=1— DyCh,p) (4—p)*?”. 
j=0 «2° 
The probability that at least one of the A messages is erroneous is 


k 2 
R=1—|| D Crp? (t—p)"’. 
i=1tj=0 ' 

4.46. Four identical parts are needed to assemble an instrument; we 
have ten parts at our disposal, six of which are sound and four are 
faulty. All the parts are identical in appearance. Five parts are selected 
at random (one extra part is taken “just in case”). Find the probability 
that no less than four of the five parts are sound. 

Solution. Therandom variable X is the number of sound parts among 
the five chosen and has a hypergeometric distribution with para- 
meters 5, 6, 4 [see (4.0.34)]. The probability that m of the five parts are 
sound is P,, = Cm™C3-™/C*; hence 

Py = 95/21, Py = 1/42, P{X>4} =P, + P, = 11/42. 
_ 4.47, There are seven radio valves, three of which are faulty and 
indistinguishable from the others. Four valves are taken at random 
and are screwed into four holders. Find and construct (as a frequency 
polygon) an ordered series of X radio valves which will function. 


Find its mean value, variance and mean square deviation. 


Solution. The variable X has a hypergeometric distribution with 
parameters n = 4, a = 4, 6b = 3. 


P,=C,C/C, = 4/35. P, = C3C3/C} = 18/35, 
P,=C3C,/C} = 12/35, P,= C3/C2 = 1/35. 
The ordered series of the random variable X has the form 
A 2 eS 4 
~ | 4/35 | 48/35 | 42/35 | 4/35 |” 
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The frequency polygon of the random variable X 18 given im Fig 4 47 
Using fermulas (4035) and (40 30), we calculate MIA) e228 
and Var[X] «0 38 

4 48* A number of independent trials are made in each of which 
an event A occurs with probahhity p Our aim is to obtain the event 
A ktumes The maximum possible number of trials 1s » (with n> 2h 
The trials are terminated etther when the event A occurs & times or when 
it is clear that the event cannot occur A times, 1e@ when the opposite 









P, 
a3 
B 
02 
| 
! of 
ict 12/1 
! tks , 
B { 2 3 4 fo 4 9 3S 4 #5 § Tf 
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event A occurs m —~A-+ # times A random variable X 1s the number 
or rials that will be made Find the distribution of the random vari- 
able 

Solution, The possible values of the random variable X are 4, A + 
i, ,%—i1, x Let us find the corresponding probabilities P,, = 
P {X = m} 

For kx mx n— k the trials will be terminated after the mth tnal 
because the event A has occurred & times Therefore, 

P,, = P {as a result of m — 1 trials the event A occurs & — 1 times 
and the mth trial yields the event 4} = 


Cm~ 1p ig™* p= Crap gq" (4 48 1) 


In particular, form = k we have P, = p* 
For n—A<cmsin the trials can be terminated after the mth 
trial either because the event A occurs for the &th trme or because the 


opposite event A occursn —k +14 times The probabiltty of the first 
variant has been calculated, the probability of the second variant 13 


P = {the first m — 1 trials yield nm — & occurrences of the event A 
and the mth trial yields the event. As = 


ona pit-i-nehgn-hp — on | pmnineh naked 
Adding the probabilities of the two varrants together, we obtain 
P,, = ott y pigit=h 4. one prninak naked, (4.43 2) 
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Thus, for k< m< n — k, the distribution of the random variable X 
is given by formula (4.48.1) and forn —k<m< n, by formula (4.48.2) 
4.49. Under the conditions of the preceding problem x= 7,k = 3 
and p = 0.4. Construct the ordered series of the random variable X. 
Solution. The possible values of the random variable X are 3, 4, 5, 6, 7. 


P= p3= 0.43 = 0.064, P, = C2 p3gi-3 = 3.0.43.0.6 = 0.115, 
P, = C321 p3q5-3 +. C178 p5-1-7#3q7-3+4 — 6.0.43. 0.62-+ 0.65 = 0.216, 

Pg = C2 pig8-3 + C73 p8-1-7+3g7-3+4 — 10.0.43-0.69 +.5-0.4- 0.65 = 0.293, 
Py = C371 p3g?3 + C18 pT-t-M43g7-341 = 15.0.43.0.64-+4 15-0.42-0.65 0.312. 
3 | 4] 5 | 6 | 7 
» {0.064 | 0.115 | 0.216 | 0.293 | 0.312 ” 


The frequency polygon is given in Fig. 4.49. 


CHAPTER-3 


Contimuous and Mixed 
Random Variables 


$0 The set of te Oe tandem variable is characterized by an uncountable 


phi F(x) = P [X < 2} (5 Of) 
jhution function exists for any random vartable whether discrete 
rf the vet bution function £ {z} of a random variable XY 1s continuous for any 


n haga derivative F (xr) everywhere except maybe at individual 
(Fig 501} then the random varable X 1s said to be continuous 


Fir 





Fig 501 Tig 502 


ution function F fz) continuously increases on certain tervals but 
ttres at particular points (Fig 50 2) then the random variable 12 
The function F (z} 1g continuous on the left for exther a mixed oF 
fom variable 
i ty of a particular individual value of a continuous random variable 
ro The probability of a particular individual value of a mixed random 
which lies on the interval of contimuity of F {z) 1s also zero while the 
lity of each of the values z, x,y at which the function F (x) Jumps 
erically equal to the value of the corresponding jump 
For any random variable (discrete continuous or mixed) the probability that 
rt will fall on the interval of the abscissa axis from a to B (including @ butexcluding 
G} is expressed by the formula 


P jas X <p} = F (p) — F (a) (502) 

sun oa up = Str a conpnucus ranabm variatib tite equarivystym t 
{902} can be neglected 

P {a <k <p} =F (p) ~ F (@) (503) 


or using another notation, 


P {XE (@, B)} = F (B) — F (x) (5 0 4} 
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The probability density (or distribution density, or density function) of a contin- 
uous random variable X is a derivative of the distribution function: 


f (x) = F'(z). (5.0.5) 


A probability element for a continuous random variable X is the quantity 
{ (z) dz, which is approximately the probability that the random variable X will 
fall on the elementary interval dz adjoining the point z: 


f(c) dew P{x<X <a dz}. (5.0.6) 


The density f (x) of any random variable is nonnegative (f (x) = 0) and possesses 
the property 


\ f (x) dx=1. (5.0.7) 


= Oo 


The graph of the density f (x) is known as a distribution curve. 
The probability that a continuous random variable X falls on the interval from 
a to B is expressed as 


8 
P{fa<X<p}= \ f (x) dz. (5.0.8) 


_ The distribution function of a continuous random variable X can be expressed 
in terms of its density: 


FP (x)= \ f (x) dz. (5.0.9) 


The mathematical expectation of a continuous random variable X with density 
f (z) is its mean value, which can be calculated from the formula 


M(x]= | af @ ae, (5.0.40) 


The mathematical expectation of a mixed random variable with a distribution 
unction F (cz) can be calculated from the formula 


M [X]= > LiPi-te \ xP" (x) dz, (5.0.14) 
i (c) 


Where the sum extends over all the points of discontinuity of istributi 
y of the distribution func- 
lion and the integral over all the intervals of its continuity. When M [X] has to 
be denoted by one letter, we shall write M [X] = m,.. 
The variance of a continuous random variable ¥ js 


Var [X] = M [X2] = M [(X — m,)3] 
and can be calculated by the formula 


oO 


‘ [X]= \ (@—ms)? f (x) dz. (5.0.42) 


8—0575 
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The variance of a mixed random variable fa expressed by the formula 


Var 1XJ= Dy ema}? prt | ems) F dz, (5049 
i (c} 
where the sum extends over all the points of diecontinurty of the function F (2) 


and the integral over all the intervals of its continuity 
The square root of varianceis known as the mean square deviation of a random 


variable 
o, =V Var [X] (> O 14) 


The coefficient of variation 
te = C,/m.. {5 0 15) 


1s sometimes used ag a characteristic of the degree of randomness of a nonnegative 


random variable 
Note that the coefficient of vartation depends on the origin of the random vari 


ahle 
The mean stare deviation can he used to approximate the range of the possible 
values of a random variable This approximation is known as the three sigma rule 
which states that the range of ihe practically possible patues of a randam variable X 
lies within the limits 


Mm, i Jd,. (3 0 16} 


This rile 1s also yajid for a discrete random variable 
The Ath moments about the origin for 4 continuous and for a mixed random 


variable 
ot, [AX] = M [XA] 


ara expressed by the formulas 


ay [X]= \ rkf (z} dz, (5 0 27} 
cn (K1= Dy aka, + | ahF (2) az (5.0 18) 

| fc} 

respectively 
The central moments can be calculated from similar formulas 

“4 ([A]= \ (z—maz)h f(z) dz (50 19) 
fk, [A] = > (z3— mJ) ppt (x—my)k F (2) dz (5 0 20} 

i (c} 


The central moments can he expressed in terms of the Moments about the ongin 
as was the case for a discrete random variable (see Chapter 4) The expression [er 
varrance in terms of the second moment about the or:gin 18 of especial practical m 
terest 


Var {X) = a, j[X} — m! (5G 24} 
or wm another notation 
Var [XJ=M [X*]—(M [X)])? (5 0 22} 


If the probability of an event A depends on the value assumed by a continuous 
random yariable X with density f(x), then the total probability of the event 4 


te $% +» 
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can be calculated from the integral formula for,total probability 
8 
P(A)= \ P (Ajx) f (x) dz, (9.0.23) 


where P(A} z)==P {A | X=2} is the conditional probability of the event A 
on the hypothesis {X =z}. 

Bayes’s formula also has an analogue for continuous random variables. If an 
event A occurs as a result of an experiment and the probability of the event depends 
on the value the continuous random variable X assumes, then the conditional prob- 
ability density of the random variable, the occurrence of the event A being taken 
into account, is 


fa (2) =f (z) P(A | 2)/P (A), (5.0.24) 
or, with due regard for formula (5.0.23), 


fa(e)=f (2) P(Ala)/ | P(Alz) f (2) ae. (5.0.25) 


This formula is known as Bayes’s formula. 


There is also av integral formula for total expectation for continuous random 
variables, i.e. 


M [X] = \ M [X |y] f (y) dy, « (5.0.26) 


where X is any random variable; Y is a continuous random variable with density 
f(y) and M {X | y] is the conditional expectation of the random variable X, pro- 
vided that the random variable Y has assumed a value y. 


fe 


G 





Fig. 5.0.4 


Let us consider the distribution and properties of continuous random variables 
that are often encountered in practical applications. 

1. Uniform distribution. A random variable X has a uniform distribution on 
the interval from a to b if its density on that interval is constant: 


_f i/b—a) for x€ (a, d), 
sw 0 for x ¢ (a, b). (9.0.27) 


The values of f (x) at points a and b are not defined, but this is i lal si 

Lu aty : S Inessential 
probability of falling in any of them is zero and, hence, the probability of vipat 
Telated to the random variable X does not depend on the value of the density f (x) 


at the points a and b*). The graph of the probability i i istr} 
tion is shown in Fig. 5.0.3," P Probability density of a uniform distribn- 


_*) From now on, when we define the densit, ; 
different intervals of the z-axi ity F(z) by different formulas on 


s, we shall not indi 
oundaries of the intervale indicate the values of f (z) on the 
Se 
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The mean value variance and mean square deviation of the random variable 
X which has density (5027) ara 


f— a)? —_ 
mpxy- 42? varpaye PO tee (5.0.28) 








respectively 

A uniform distribution is inherent in the Measurement errors when wang an i 
strument with large diyis cns when the value chtained is rounded off to the near 
est integer (or to the nearest smaller number or nearest larger number} For instance 
the error (in centimetres) when measuring the length of a pencil with a ruler with 
em divisions has a uniform distribution on the interval {-- 4/2 1/2) if the value 
is rounded off to the nearest integer andon the interval (2 i} 16 it is rounded down 


é E c é 
xy r 
rig 50.5 


to the nearest smaller value The error (in min) made uging a watch with a Jumping 
minute hand also has a uniform distribution [the interval (0 41)] The rotation angle 
® of a well balanced wheel (Fig 5 0 4) has a uniform distribution on the interval 
(0 2} if rt 1s set in motion and stops by friction In Buffon s needle problem {see 
problem 4 45) the angle which defines the direction of the needle also has a uniform 
istrubution since the needle 1s thrown at random so that none of the values of 9 

is more likely 

Typical conditions for the occurrence of a uniform distribution are the following 
a point Af is thrown at random onto the + axis divided into equal intervals © 
length i (Fig $05} Each of the random intervals X and ¥ ito which the powt it 
me i the interval in which it has fallen has a uniform distribution on the inter 
va 

From now on we shall often use a briefer notation 


f(x} —aiffe—era} for zE(s 53 (5 0 29) 


for probalnlity density rather than the more detailed qotation as in (5 0 27) 
2 Exponential distribution A random variable X has an exponential distrifu 
fron if its density 1s defined by the formula 


am HE 


for «20 


5 0 30) 
0 for z#<c 


re | 


whete 4 1s the parameter of the expanential distributuan (Fig 508) An exponential 
distribution is especially significant in the thecry of Markov processes and the queve 
ing theory (sea Chapters 10 and 41 

If there is a simple flow with imtensity 4 on the tame axis Of {see Chapter 4) 
then the tame interval J between two neighbouring events hag an exponentia 
distribution with parameter 4 

The mean value vamance and mean square deviatwon of the vanable X whrel 
has ah exponential distribution are 


M [X] = 4/4, Var [X] = 1/23, ao, = 1/% (5 0 34) 


—eE a 


trespectively The coefficient of variation of an exponential distrrbution is unity 


Vy, — O,/m, == 4 


Ch. 5. Continuous and Mixed Random Variables 417 


We shall often replace the more detailed notation for the exponential distribu- 
tion (5.0.30) by a briefer one, i.e. 


f(c)=te-** for 2>0 


or the even briefer notation 
f@)=he™* (c> 0). 
A table of the function e”* is given in Appendix 3. 


9. Normal distribution. A random variable X has a normal distribution (or has 
a Gaussian probability distribution) if its density 


(x—m)2 


: 20° (5.0.33) 


—— @ 
OV 2n 





f (z)= 





(Fig. 5.0.7). The mean value of a random variable which has this distribution is 
m, the variance is o2, and the mean square deviation is o. The probability that a 





Fig. 5.0.6 


random variable X, which has a normal distribution with parameters m and a, 
will fall on the interval from a to B is expressed by the formula 








P{Xe (a, B}=o(f—")_o(2—"), (5.0.34) 
Where @ (z) is the error function: 
x t? 
__} 2 a, 
0 @) = ‘i d (5.0.33) 


The error function has the following propercies: (1) ® (0) = 0; (2) O(— x) = 
—@(z) (an odd function); (8) P (oo) = 0.5. Thetables of the error function 
are A ohh in Appendix 5. 


i ee (a, B) is symmetric about a point m, then the probability of fal- 
ing in i 


P{|X—m|< 1} = 20 (i/o), (0.0.36) 
Where 1 = (B—c)/2, i.e, half the length of the interval. 


Normal distribution arises when the variable X results from the summati 
ation of 
a ‘arge number of independent (or weakly dependent) random variables which are 
Chaparable as concerns their effect on the scattering of the sum (for more detail see 
ap. 8). Tables of the normal density form = Oando = 1 are given in Appendix 4, 


*. 
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Problems and Exercises 


5.4. We are given an arbitrary value of an argument (1) Gan the 
distribution function be greater than unity? (2) Can the probability 
density function be greater than unity? (3) Gan the distribution function 
he negative? (4) Can the probability density function be negative? 

Answer, {1} No, {2} yes, (3} na, (4) ne 

5.2, What 1s the dimensronality of (1) the distribution function, 
(2) the probahility density function, (3) the mean value; (4) the variance, 
(5) the mean square deviation; (6) the third moment about the origin? 

Answer. (1} Dimensionless, (2) the inverse of the dimension of the 
random variable, (3) the dimension of the random variable, (4} the di 
mension of the square of the random variable, (5) the dimension of the 
random variable, (6) the dimension of the cube of the random variable 





Pig 33 Fig o 4 


9,30. Given the graph of the probability density function /, (x) of 
a random variable X (Fig 53), construct the probability density 
function f, (z} of a random variable Y = X -+- a, where a 1s a nonran 
com vartable Write the expression for f, (z} 

Solution. The distribution curve of the random variable Y 1s the 
same fe) ay of ey Tipution of 7, (x) but shifted to the right by ¢, 
te, fy (zt) =f, (@~—e 

0.4. Given the graph of the distribution function F, (x) of a random 
variable X (Fig 54), construct the distmbution function F, (x) of 
the random vanable ¥Y = —X, 

Solution, F, (xz) = P {Y <x} = P {—-X <tr} = P(X > —1} = 
1{--P {A <l —zp}= 4 — F, (—2) 

To construct the graph of the function F, (—z), we must consider 
the rmurrar reflection of the curve of F x (x) about the axis of ordinates 
and subtract each ordinate from unity (see the dash line in Fig 9 4). 

9.9. Construct the distribution function F (2) for a random variable 
which has a uniform distribution on thefinterval (a, 5). 
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Solution. 
x 
F(z)= | f(a) da, 
0 for zr<a, 
He= iW(b~a) for ax<iz<d, 
Q for x«>b, 
0 for xa, 
F(zr)= 2 (x—a)l(b—a) for a<z<d, 
1 for x«>b 
(Fig. 9.9). 


5.6. The random variable X is distributed according to the “right 
triangle law” in the interval (0, a) (see Fig. 0.6). (1) Write the expression 


F(z) 


D a 





Fig. 5.6 


for the probability density function f (x); (2) find the distribution func- 
tion /' (x); (3) find the probability that the random variable X will fall 
on the interval from a/2 toa; (4) find the characteristics of the vari- 
able X: m,, Varx, Ox, bs [X]. 


Answer. 
(1) j(2) = | 2(t—x/aj/a for x€(0,a), 


0, for 2x&€(Q, a), 
or more concisely f(z) =2(1—z/a)/a for x€ (0, a), 


0 for 2<0, 
(2) r=} a(2—afa)/a for O0<2e<a, 
1 for x>a, 
(3) P{X € (4/2, a)} = F (a) — F (a/2) = 1/4, 
(4) m,=a/3, Var, =a2/18, 6,=a/(3 V2), by formula (4.0.15) 
us LX] = a3 [X] — 38m,a, [X] + 2m32 = 3/135. 
9.7. A random variable X has a Simpson distribution (obeys the 


“law of an isosceles triangle”) on the interval from —a to a (see 
Fig. 5.7a). (1) Find the expression for the probability density function: 
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(2} construct a graph of the distribution function, (3) find m,, Var, 
Ox, [tg LA] (4) find the probability that the random variable X will fail 
in the interval (—a/2 a). 

Answer (1) 


(1-=) for Oe ze<ta, 


i 

ii ia 
fix= =~ (1+=) for —a<iz<0, 

0 for xr<c—~a or r>4a4, 
or, more concisely, 


f(zy=t (1-421) for 2€(~2, a), 


(2) for z € (—a a) the graph of the distribution function 15 formed 
by two parts of the parabola (Fig 5 75} 

(3) m, = 0 Var, = a/6 o, = alf'b, u,fAl=0, 

(4) P{X €(—-af/2 a} = 78, 

58 The random variable X has a Cauchy distribution, re f(t) = 
ain (1 + 27) (4) kind the factor a (2) find the distribution function 


F(z} 





— 


Fig 57 


F (x), (3) find the probability that the random variable X wll fall on 
the interval (—1, +1}, (4) find whether the numerical characteristics, 
re mean value and variance exist for the random variable + 


Answer (hast, (2) F(z) = + arctan +>, (3) P{-1<0 X < 


i} = 1/2, (4) the characteristics m, and Var, do not exist since the 
mtegrals for them diverge 

29 A random variable X has an exponential! distribution with param 
eter np, 106 f(z) = pe #* for r=>O (1) Construct the distribution 
curve, {2} find the distribution function F (rz) and construct its graph 
(3) find the probabihty that the random variable XY will assume a value 
smalier than the mean 
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for z<Q, 
—e-¥x for xs>0 


Answer. (1) See Fig. 5.9a; (2) F(a) =| { (see 


Fig. 0.9b); 
(3) m, = I/p; P{X < 4/p} = F (t/p) = 1 —e7 ew 0.632. 


F(z) 





(a) 
Fig. 5.9 


5.10. A random variable X has a Laplace distribution, i.e. f (x) = 
ae-**|, where ’ isa positive parameter. (1) Find the factor a; (2) con- 
struct graphs for the density and the distribution function; (8) find m, 
and Vary. 

Answer. 


1 - 


(1) a= /2, (2) roy . { 


es a for z«>0Q., 


rhe graphs of the density and the distribution function are given in 
Fig. 5.10a, b; 

(3) m, = 0; Var, = 2/h. 

5.41. A random variable R, which is the distance from a bullet hole 
to the centre of the target, has a Rayleigh distribution, i.e. f (r) = 
Are h*r’ for r > 0 (Fig. 90.114). 


i: 





a Pe) f(r) 


0 
(a) (6) 0 r 
Fig. 5.10 Fig. 5.44 


_ Find (1) the factor A; (2) the mode o# of the random variable R, 
le. the abscissa of the maximum of its probability density function:. 
(3) m, and Var,; (4) the probability that the distance from the bullet 
hole to the centre of the target will be less than the mode. 


Answers (1) A=2h?; (2) ot =1/(hY 2): (3) m,=ot Va/2= 
V x/(2h); Var, = (4— 1)/(4h?) = of? (4—2)/2; (4) P{R< ch} x 0.393- 
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512 Arandom variable X has a density f, (x) with probability p, or 
a density f, (z) with probability p. (pn, + p, = 1) Write expressions 
for the density and distribution function of the variable X Find its 
mean value and variance 


Solution By the total probability formula with hypotheses #7, = 
{the variable X has a density f, (z}} and H, = {the varrance X has 
a density f, (z7)} we have 

F(z) =P{X <r} = pyPy (2} + Pals (2), 


ac 


where Fy(z)= [ f(z)dz F,(2)= | f,(2)dz 


f(z) — F(z) = py fl) + Pal, (2) 
By the formula for the complete expectation 


he — Py \ rf, (z) Git p, \ If _ (x) Ax = Pylty, + Peltz 


at 


where m,, and m,, are the expectations for the distributions f, (2) 
and jf, (=) 


We find the variance from the second moment about the origin 


Var Pity t Prttaa— mip, \ 2%fy(2)dztp, | xf, (2)dz—mi 


where a, and a4, are the second moments about the origin for the 
distributions f,; (x) and f, (z) 

013 Balls for the ball bearings are sorted by passing them over two 
holes If a ball dees not pass through a hole of diameter d, but passes 
through a hole of diameter d, >> d,, then 1t 1s accepted otherwise it 18 
rejected The diameter D of a ball is a normally distributed random 
variable with characteristics mg = (d, + @,)/2 and og = (dy — @,)/4 
Find the probability p that the ball will be rejected 

Satution The interval (d,, d,) 1s symmetric about mg Setting / = 
4d, — d,)/2 and using formula (5036) we find the probability that 
the ball will not be rejected 


P{} D—m) <(d,~d,)/2} = 20 ( 42—41), 





whence 
—1{-~20 f 224) 1-9 (Sar) 4 = 
p=1—20 (4+) = 1-20 | Ena j= 2 (2) = 0 0455. 


014 Under vhe conditions of the precedin,-problem find the mean 


square deviation ay of the diameter of the ball given that 10 per cent of 
all the balls are rejected. 
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Solution. The probability of a reject 
p=1—20 ( 4) 04, ® (2="1) = 0.45, 


204 204 


Using the tables for the error function (Appendix 5), we find the argu- 
ment for which the error function equals 0.40: 


(d, — d,)/(2o4) + 1.65, og +4 (@, —d,)/3.3. 





5.145. When a computer is operating, faults may occur at random 
moments. The time 7 a computer operates until the first fault occurs 
has an exponential distribution with parameter v : @ (¢) = ve7v'(t > OQ). 
When a fault occurs, it is detected at once and the necessary correc- 
tions are made within a time ¢, after which the computer begins to 
operate again. Find the density f (f) and the distribution function F (f) 
of the time interval Z between successive troubles. Find the mean value 
and variance. Find the probability that Z is larger than 2¢,. 

Solution. Z=T + ip; 


@vV( t-te) — e—Vv(t—to) 
i={™ v for t> tp, r={o e7v for t> tp, 
¢ for i<‘f, 0 for t<fp, 
M[Z]=41/v+i,, Var[Z]=1/v?, P{Z>2tp}=1—F (21,) =e-vo, 


0.16. The time 7 between two computer maliunctions has an expo- 
nential distribution with parameter A, i.e. f (£) = Ae?! for ¢ > 0. 
A certain problem requires a failure-free computer run for a time T. 
Ifa malfunction occurs during the time t, the solution of the problem 
must be restarted. A malfunction is detected only in a time Tt after 
the solution has begun. We consider a random variable 9 which is the 
time during which the problem will be solved. Find its distribution 
and expectation (the average time needed to solve the problem). 

Answer. The random variable © is discrete and has an ordered series 


t [2t|...| i es 
p | pq|... | pgit |...” 


Where p=e-4t, g=1{—p=1—e-*. M [Oj =t/p = te-**, 
0.17. Under the conditions of the preceding problem, find the proba- 
rps aa no less than m problems (m < k) will be solved duriug time 
Solution. We designate as P,,, , the probability that exactl 
problems will be solved during the time t = kt. BD. , is i. 
ability that exactly m of thek time intervals twill be without malfunc- 
tions. The probability that there will be no malfunctions during the 


lime interval tis p = P (7 >ft) = eA 
va = = . According to the theo 
the repetition of trials : . oe 


Pr p= Ch p™gh-™ — Che~mat (1 — em ary k-m, 
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The probability that no less than m problems will be solved 1s 


h h 
Rin p= 2p Pr p= dy Cron (ten 
i=mM {=m 
Or more conveniently, 
m i 
Ry p=i— dy Crem (107 Asy hi 
i—d 


8 {8 Prove that the distribution of the intervals between the succes 
sive events in a simple flow with intensity 4 1s exponential with par 
ameter A 

Solution We first find the distribution function F (/} of the random 
variable T which is the distance between the stccessive events 

F(t) = P {T < t} = P {at least one event in the elementary flow 
occurs during the time #} = 1 —e 4! for? >>0 hence / (t} = F ()= 
Ae 4f for t => 0 

919 Given a Poisson field of points on a plane with a constant 
density 4 find the distribution and the numerical characteristics m, 

Var of the distance A from any point in the 

, eof, field to its nearest neighbour 


o “se » Solution We find the distribution function 


e ° F ir) of the vanable R by drawing a circle 
. ° of radius r about a point im the field (Fig 5 19) 
° « For the distance A from the point to its nearest 


*, 2» * neighbour to be smaller than r at least one other 
. ° point must fall within the circle The proper 
Fig 519 ties of the Poasson fields are such that the 


probability of ths event 1s imdependent of 
whether there is a point in the centre of the field or not Therefore 
Fir}—i—e-™’ (r= 0), 
whence 


(r)—2mAre ™ (p> 0} 
This distribution 1s known as a Rayleigh distributton (see Problem 5 14 


=_ —TATS fe _t 
Tip r2mAre dr Vi 
—. ¢ = The 4 
@_ [A] = | r82mhre~™! dr = t, 
v 
Var, = @, (Al — m= 1i(ad\— 144) — (4 — a) faa} 


9.20. Points are located at random in a three dimensional space 
The number of points in a certain volume pv of the space 1s a random 
variable which has a Poisson distmbution with expectation ¢ = AY, 
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where A is an average number of points per unit volume. We have to 
find the distribution of the distance R from any point in the space to 
the nearest random point. 

Solution. The distribution function F (r) is defined as the probability 
that at least one point falls in a sphere of radius r: 


F(r)=P{R<ry=1—e-'™, 


where v(r) = tar is the volume of the sphere of radius r. Hence 


4 bj 
f(ir)= 4nrthe 3" (r > Q). 


5.21. The stars in a certain cluster form a three-dimensional Poisson 
field of points with density 4 (the average number of stars per unit 
volume). An arbitrary star is fixed and the nearest neighbour, the next 
(second) nearest neighbour, the third nearest neighbour, and so on, are 
considered. Find the distribution of the distance A, from the fixed star 
to its nth nearest neighbour. 

Answer. The distribution function F,, (r) has the form 


n—-i 
k 
F,(r)=1— >) Se, where a=tar (r>0), 
k=0 


the density function is 





dF oon ase 
0.22. Trees in a forest grow at random places which form a Poisson 
field with density 4 (the average number of trees per unit area). An 


arbitrary point O is chosen in the forest and the following random 
variables are considered: 


R,, the distance from O to the nearest tree; 

Ry, the distance from O to the next (second nearest) tree; 
Ra, the distance from O to the nth nearest nee: 

Find the distribution for each variable. 


Solution. We found the distribution function of the random variable 
in Problem 5.419 to be 


Fy (r)=1—e-™a (rr > 0). 


The distribution function F, (r) = P {R, <r} is equal to the prob- 
ability that no less than two trees fall in a circle of radius r: 


Py (r) =1—e-7"* — greek = (r > 0). 
Reasoning by analogy, we obtain 
n—{ 
F, (r)=P{Ry<r}=1— Sy Se (0), 


k=0 
Where a = sur*A. . 
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To get the density j, (7), we differentiate F, (7) with respect tor, re, 





nan 4 ri % 
dF alr) da gk ak 
pmsl (Fao FS) a 
k=) al 


a 


L 
=P a2 MAr ("> O}. 


5.23 An automatic traffic signal at a crosging 15 8et So that a green 
light turns on for a mmute and then a red light turns on for 0 95 mu, 
then a green lrght turns on again for a minute and a red ight for half 
a minute, and so on A certain Petrov arrives at the crossing in a tar 
at a random moment unrelated to the operation of the traffic signal 
(1} Find the probability that he will pass through the crossing without 


F fi) 





Fig 5 23 


stopping, (2) find the distribution and the numerical characteristics of 
the waiting time at the crossing 7,,, (3) construct the distribution 
function F (f) of tae waiting tume T, 

Solution The moment the car arrives at the crossing 1s untformly 
distributed in the interval which 1s equal to the traffic signal cycle, 
re to14+ 035 =15 mim (Fig 5 232) 

For the car to pass through the crossing without stepping, 1 must 
arrive during the interval (0 1) The probability that a random vari- 
able umiormly disinmbuted im the mterval (0, 15), will fall in the 
interval (0, 1) 15 2/3 The waiting time 7, 13 a mixed random variable 
It 1s equal to zero with probability 2/3 or may assume any value between 
QO and 05 min with uniform density with probabihty 4/3 The graph of 
the distribution function F (t) 1s shown in Fig 5 236 

The average waiting time at the crossing 


M{7,] = 0 2/3 + 0.25 1/3 ~0083 min 


The variance of the wanting time 


O 5 
Var [Fy] = [Tw] —(M[Py))?= 0? 2+ 4 ot dt 


— (0 083)" 27 0 0208 min, of, a 0 144 min 


Ch. 5. Continuous and Mized Random Variables 127 


5.24. The normal distribution function. A random variable X has a nor- 
mal distribution with parameters m and o. Find its distribution func- 
tion F (2). 

Solution. 


(x2) =P{X<z}=P{—-w<cxrA<yz} 
Loe 7) —®(— co) =0 (7) +05. 
5.25*. Show that a function of the form 


f,(z)=az*e-*** for zx>0 








Ia >0 and a>O are constants and s is a natural number (s = 4, 
2, 3, ...)] possesses the properties of a probability density function. 
Find the parameters a and @ given a mean value m,., and find Var,. 
Solution. The parameters @ and @ can be found from the conditions 
| azte- (ax) da — 1, \ ax®tig—(axy dz — m 

0 


ow 


Using the substitution (ax)® =#, we reduce the integrals to the gamma 
function 


j xse~ (ax)? dz — — \ eter dt=T (- bo ) /(2a*), 
0 0 


where I (m) = | etim-i dt (m>0) with [(m-+-1)=mI'(m); for the 


0 
integral n=1, 2, ... we obtain [(n+4)=n!l, P(n+4/2)= 
a Va, (Qn—1)"l=4, 3, 5, ..., (2n—1). 

From the given conditions we find that 


aD (=+*) / (Qas)—=41, aP (==) / (2a,5*2) = m,., 








whence 
r ( st+2 
—_ 20st isco 2 
T ( s-}-1 : Me T ( s+41\° 
_—" 7) 


The second moment about the origin 








00 r (==) s-4 r (=4*) 
Qs [A] = \ axzst2a-(ax)? Ce a ae ya a, Sy s+4 
208+3 2astig? ma 92 7 
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whence 44 
a 
4 
y __ [xX : sti mt mm (s-P OE ( 2 _. | 
AP y == Oy lA] — My = —peg* — Mx — Mx ‘42 ' 
art { = } 


Some of the distributions of the form f,(r} have definite names 
eg f, (x)1s hnown as a Rayleigh distribution, and f, (z), ag a Maxwell 
distribution Jor a Rayleigh distribution (s = t} we have f, (2) = 
ax e7= x" (7 > 0} 


t=, a= 2a? = Te Var, =my|—— 1]. 





For a Maxwell distribution (s = 2) wa have f, (z} = ex*e-*" 








7 2 _ 423 32 =m; (+2 — 1) 
rn ae i= Vx = Tims Var, = mx 8 { 
Remark All the distributions of the form 
f.(xj=arte "(zr > 


for a 42ven s have a single parameter 1e they depend only on one parameter, which 
mat be either the mean value cr the variance, 


5 26*, VWoments of a normal distribution Given a random variable 4 
which has anormal distribution with parameters m and a, find the expres 
sion for the quantity a, [X], whichis the sth moment about the origin 

Solution Let us express the moments a, [X] = M [X*] about tha 
origin in terms of the central moments p,1X} = MitX — my‘) 


t= M[(X—m+m)"]= 2b Cra (Xpme* wo [X] = 1. 


For central moments with odd s=2n+14, we have 


oS 








xy ‘ -i Gm 1 | ~savy 0 
= — a £2 oh fe ? 2a? = 
iy [A] 5 ta je mye Bees iv y 


and with even s = 2n, by the formulas in the preceding problem, 
we have 








Hy [X] = [ ye BF oy : ye (3 i) dy 
oy on “ oy 2x 
oni 
i] 
2 2 _ n 
= V2 = On Me? 


For example, 








2[XJ= 07, = a, [X} = mn? -}- 0?, 
a, fA} = m3 -L 3q%m, 
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u,{X]=30%, oa, [X]=m*-+ bom? -- 30+, 
os [X] = m5 + 1002m3 + 5- 304m, 
Ug (X] = 150%, a%g [X] =m + 150m! + 15. 30%m? + 150°. 

5.27. Arandom variable X has a normal distribution with parameters 
m and o. Write an expression for its distribution function F (x) = 
P{X <x}. Write an expression for the distribution function 
Y (y) = P {Y < y} of the random vari- 
able Y = — X, 


Solution. In accordance with the solu- 
tion of Problem 5.24 


F(z) =® ("=") +0.5, 


0 
¥(yy=P{Y <y)=P{-X<y} 
=P(X >—y)=1—F(—y) 


=) (etm) 40.5. Fig. 5.28 


F(x) 








0.28", The distribution function F (x) of a nonnegative random 
variable X is given by a graph (Fig. 5.28). The mean value of the ran- 
dom variable X is m,. Show that m, can be represented geometrically 
as the area of the hatched figure in Fig. 5.28 (bounded by the curve 


y = F (x), the straight line y = 1 and the axis of ordinates). 
Solution. We have 


mn, = \ Lila) as = \ xk’ (x) dz= — x[1— Ff (x)]’ dz. 
0 6 0 
Integrating by parts, we get 
My= —x[1—F (z)] | | MF (2)] ae. 
0 0 
Let us prove that the first term is zero: 


x[1—F(2)] | =lim x[1—F (z)]=0. 
pS 


Indeed, for the nonnegative random variable X » Which has a finite 
mean value, it follows from the convergence of the integral 


co 


\ af (x) dz that \ xf (z)dz—»>Q0 as Koo and, since 
0 K 


oO 


K | f(a)dr< \ xf (z) dz 
K K * 
39-0575 
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tt follows that A [1--F(4)]-+0 as A-+ oo Consequently, imz[i~— 
x + On 
F (z)]=0 ence 


mm, = | (1 F(zitdz, 
0 


and this is precisely the area hatched in Fig 35 28 

5.29 Arandom varlable X has a normal distribution with mean value 
m=0 (Fi¢ 629) Given an interval 
ifr} (z, B) which does not include the 
origin, for what value of the mean square 
deviation o does the probability that 
the random  yartable A wall Gail m the 

intersal (a, fi) attarzn a matimum? 
Solution We find the :alue of o by 
differentiating the probability of falling 
in the interval (a, 6) with respect to 
"ue &B ad o and equating the derivative to zere 

Fig 5 29 Woe have 


Bb & 
Pla A <p} = (t)—o (-=} =e |ie ten e ‘a ' 
a o 





d — 1 “fae _ & a “Boyd _ == 
hence 
ae a 
Be 2o — oO 2o% 


and consequently, 
o= ps mp bre p—a 

2 (ln B-—In e) 2" Inp—Ine * 
For a small interval (2 — ce, @ + ¢&) 

o wali — (e/a)*/6} wa 
For instance, for e/a << 0 24the formula o va yields an error, smaller 
than one per cent 

230 A random variable X has a normal distribution with expetia 

tion mand mean square deviation 0 We must approaimate the norma 
distribution by a uniform distribution in the interval (a, B) with the 


boundaries a and fh chosensuch that the mean value and variance of A 
are retuned constant 


Soiution For a unliorm distribution on the interval f« 4¥) 
M[A]=(@+6)/2, o (Xl = @ —e«y2y3), 
G+ $/2=m, —al2V3}=a 
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Solving these equations for @ and f, we have 


ao=m—oV3, p=m+oV3. 


5 34. A continuous random variable X has a probability density 
function f (z). As a result of an experiment it Is found that an event 





Fig. 5.31 Fig. 5.32 


A = {X € (a, 8)} [the random variable X falls on the interval (a, )! 
occurred. Find the conditional density f, (x) of the random variable X 
provided that the event A occurs. 

B 


Solution. P (A) = f (x) dx. By Bayes’s formula (5.0.24) we have 


a 


B 
t, an i(e/{ J f(2)dxz} for x€(a, B); — 
0 for x(a, B). 


The distribution curves f (x) and f, (x) are shown in Fig. 5.34. The 
ordinate of the curve f, (x) at each point is equal to that of the curve 
] (x) divided by the area S hatched in Fig. 5.31. Since S < 4, it fol- 
lows that /, (x) > f (x) for any z € (a, 6). 

0.32. A factory manufactures homogeneous articles whose rated size 
is 1, but for which random size deviations are actually observed that 
have a normal distribution with mean value m = 0 and mean square 
deviation o. The sorters reject every article whose size differs from the 
rated size by more than a tolerance A. Find the probability of the event 
A = {an article will be rejected}. Find and construct the probability 


density function for the size of the article which passes the sorting. 
Solution. 


P(A) = P {|X | > A} = 1 — 2@ (Alo), P (A) = 20 (Alo). 
By formula (5.31) we have 





phat)... 1 - = 
a (2) P(d) 20Vano(ajo) «IISA. 
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The size 1 of an article which passed the sorting is equal to the 
error X plus the rated size /, and has the conditional density 


_ {x= i)? 


, Ze* for ZE{ip—A, ly), 


94 (7) 24 V an D (Ajo) 
shown in Fig 5 32 

5 33. The reliability p of a device depends both on tho total elapsed 
time T from thea moment the device was turmed on and on whether the 
voltage regulator failed at some moment ¢ <t tv. If the voltage regulator 
does not fail until tha moment t, the reliability is defined by the func 
tion p = p, (t), 1f 14 fails ai the moment ¢t << 1, then the rehabilsy 1s 
a function of two arguments p = p, (t, 2) The time of the failure free 
performance of the voltage regulator 1s arandom variable 7 with den 
sity { (f) Find the disinbutiion fonction Fefz} of the time 6 of the 
failure-free performance of the device and its expectation mes 

Solution The complete reliability of the device (the probability of 
its failure free operation for the time 7) can be found from the total 
probability mtegral formula 


t 


p(t)= | pts t) f(t) dt-+ po () | f(nyat 


The function of time distribution G 
Fo (z) = P {(O <x} = 1 — p (x). 


Since the quantity G 1s nonnegative, it follows (see Problem 5 28) 
that 


me=M[0)= } {t—Fe(s))dz= | pirat. 
0 0 


5 34. A message S 1s expected over a communication channel The 
moment 7 the message 1s received 1s accidental and has density func- 
tion f ({} At a moment T 1t 1s found that the message has not yet @r- 
rived. Under this condition find the distribution density @ (¢) of the 
time © which remains until the arrival of the message 5. 
Solution. According to Bayes's formulas, (¢}), which 1s the conditio- 
nal density of the quantity 7 provided that an event A = {the message 
has not arrived by the moment +} occurred, 13 
pte vet) 

P(4) for t=>>T 

_- {— t} de , 
falij= ; Fe 


0) for i<T, 
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Since O = FT —T, it follows that 
f (t) 


for t>0Q, 
p(t) = <7 f (t) dt 


0 for t<0. 


Fig. 5.34, shows f (é) and g (é); for the distribution o (¢) the origin 
coincides with the point Tt. 

5 35 The moment 7 an event A occurs is a random variable with an 
exponential distribution, i.e. f (t) = Ae (¢ > 0). It became known 





Fig. 35.35 


at a moment t that the event A had not occurred. Find the conditional 
distribution density @ (é) of the time O remaining till the occurrence of 
the event. 

Solution. The event B = {the event A has not occurred by the mo- 
ment t} occurred. Thus 


P(B)=1— \ f(t) dt=e-™. 
0 


fa(th=f (t/P (B)=Rewttle-t = eA “(2 > 4). 
The random variable 0 = T — t has the conditional density 
p(t)==Aem** for t>0, 


1.6. an exponential distribution which coincides with / (z) (see Fig. 5.35). 
Thus, the conditional distribution of the time © which remains till 
the occurrence of the event does not depend, foranexponential distribu- 
tion of 7’, on the elapsed time. An exponential distribution is the only 
distribution which possesses this property. Recall that the time inter- 
val between two successive events in an elementary flow has exactly an 
exponential distribution: the time remaining till the occurrence of the 
next event does not depend on how long we have been waiting for it 
(this follows from the absence of aftereffects in an elementary flow). 
_ 9.36. The probability of a failure of a radio valve at the moment 
it is turned on depends on the voltage V in the circuit and is equal to 
q(V). The voltage V is random and has a normal distribution with 
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parameters v, and o, Find the total probability g of a failure oi the 
yalxe a the moment it is turned on. 
Solufion. By the integral total probability formula (5 0 23) we have 
co oo _ {r=toy? 


r= | a) {@) dom | rive 28 dy. 


537 A random yoltage V, which has a probability density f (0), 
is passed through a voltage limiter which cuts off all voltages smaller 
than v, and larger than v,, 1n the first case raising the voltage to x, and 

in the second case lowering it tov, 

Find the distributien af the random 

Flv} Pty) Ftv} variable V, the voltage which has 

passed through the limiter, and 

determine its mean value and 
variance 

Solution. 


Ys for P <— Ly 
VY VY for Bp ac VP <p, 
vs for ¥ a Us 





Fig 537 


The random variable V 1s a mixed 
quantity and its two values }, 
and v, have nonzero probabilities p, and p, For all the values between Y 


and v, the distribution function P (v) of the variable V ts continuous and 


t oS 


Fo)= | fwd, y= J fed, m=) fea 
The graph of the function F (v) 1s shown in Fig oa 37, 


iT 


M{VI=vpi trap, t | of (ode. 
Var [V) = a4 1¥}— (MV), 


Ol) J = vi p,+vbp,+ ( vf (v) dv 


Ty 

5.38, A message of length }1s being broadcast over a radio channel 
(Fig 0 38a) In order to eraze the message, a nose pulse train of length 
6 => 11s injected into the channel so that the centre O, of the train coin- 
cides with the centre O of the message 

Because of accidental errors, the centre of the pulse train proves 
to be dusplaced by X relative to the centre of the message The Tandom 
variable X has a normal distribution with parameters m = 0 and ¢ = 
H/2Z. Find the distribution of the randam varible U, the length af the 
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message which is erazed, and the mean value m,, the variance Var,, and 
the mean square deviation Oy. 

Solution. The random variable U is mixed; it assumes the values 0 
and 1 with nonzero probabilities. On the interval from 0 to / the dis- 
tribution function F (u) is continuous. The noise train & does not touch 


IE TBST 


(2) 
Fig. 5.38 


Xx 
ee 
\ 9; 
0 i , 





the message 1 (U = 0) if its centre is further than (b + /)/2 from the 
origin. 


pa? U=0)=P {IX > $4} at (1x1 < tf} 


= 120 ( aa )=1—20 (---), 


For the noise b to eraze the whole message 1 (U = 1), its centre O, 
must be less than (b — ])/2 distant from 0: 


a=PU == P{Ik| <-z}=20(-"). 


For (b — D/2< X < (b + 1)/2 a part U of the message I is erazed 
(0<U <1). We find the distribution function ofthe random variable 
U:P {U <u} forO <u <l. For the erazed part to be smaller than 
w, the centre O, of the pulse train must be further than (b + 1)/2 — 
wu = (b + 1 — 2y)/2 from the centre of the message: 


Fu) =P {|X|> ot} a1 P {ix} < os 
=1—20 (“TE ) 


Thus, on the interval from 0 to 1, we have F (u) = 1—2®@ —— 
(Vig. 5.388). 
To find the mean value and variance of the random variable U , we 
must find F’ (:) on the interval (0, 1). Taking into account that 
b+i-2u 
x {2 l {2 
4 aie y b-+-1—2u 1 Parisi 
M = 2 a 
(2) = = \e a, © (=e e 2 dt 








i 
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and differentiating F (z) with respect to the variable u, which appears 
in the upper limit we obtain 


(h+i— Ful 


Pu)dua pppoe 7 du(O<u<)) 


M{U]=0 pole; + \ uF (u) du, 
g 


@y[U}=0 po + lp, -+ | uF (u)du, 
f 


Var [U]=a,{G7]—(M[v])*, o= Y Var (U] 


5 39 The random vartable X may have a distribution density f,'(2) 
with probability p, a density f, (x) with probability p,, ; a den 


Fir 
BF 


i? 


oe 





rg 
5 432% # ¢ 23 4 F 


Fig. 5 39 Fig. 5 40 


sity f; (xz) (} = 1 . ”) with probability p;. Find the total (aver 
age) density of the random tariable X 

Solution We find the element f (x) dz of the probability by the total 
probability formula on the hypotheses H, = {the density of the ran 


dom variable 1s f; (x)} @ = 1, mn) By the total probability for- 
mula 


f (2) dz 2 Pif, (x) dz 
whence 


f(zj= 2 Pifi (2) 


In particular, if there are two hypotheses and their probabilities are 
Py = P, = 1/2, then f (z) 1s half the sum of the densities f, (x) and 
J, {z) (Fig 529) Two humps’ on a distribution curve always rmply 


that the distribution has been obtamed by averaging two distributions 
of different types 
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5.40. The random variable X may have a normal distribution with 
parameters m = Oando = 2 with probability 0.4 or a normal distribu- 
tion with parameters m = 2 and o = 4 with probability 0.6. Find the 
probability density function of the random variable X. 

Answer. 





f@= sae Fos 


The graph of f (x) is shown in Fig. 5.40. 
5.44. Two independent random variables, a discrete variable X 


with an ordered Series 
m| 22]... [an 


Pi| Pa] ++ | Pn 


e 
e 








and a continuous variable Y with density f (y) are summed up, i.e. 
Z= xX +/Y. Is the resultant random variable discrete, continuous or 
mixed? Find its distribution. % 

Solution. The random variable Z is continuous. Its density f (z) 
can be found by the total probability formula on the hypotheses H, = 
‘A= 2), He = {XxX =a) «nny LH, =] {xX — 2}. For. the. ith 
hypothesis, the conditional element of the probability of the random 
variable Z is 


fi (@) dz = f (2 — z;) dz. 
The total element of probability 


7 (2) dz= 2, Dif (2 2;) dz, 


whence 
7(2)= 2 pif @— m1). 


0.42. Given a variable Z = min {X, a}, where X is a continuous 
random variable with density f (x) and a is a nonrandom variable, is. 
the given variable discrete, continuous or mixed? Find the distribution. 
of the random variable Z, its mean value and variance. 

Solution. The random variable Z is defined by the formula 


P [ if X <a, 
la, ib XDda. 


The value of the random variable Z = a has a probability 


Oo 


Pa=P{X > a}=P{X>a}= | f(a) dz. 


Pode = > 0 the random variable Z is mixed and for Pa = 0 it is con- 
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For Z <a the distribution function F (z) of the random variable Z 


a 
coincides with F (x) = Vf (x) dx (Fig. 5 42} 


iit ee! 


M[Z]=ap,+ \ xf (x) dz, 


Var[Z]=<a,[Z]—(M[Z])*, a, [2] = e2po-+ | ztf (2) de. 


— io 


lf P(X Sob = 0, then Z = mm (X, a} = X, FG) = FG). 

o 43, Perrodic signals of the same duration / and with the same 11- 
tervals ZL between them are sent from two sources A and B (Fig. 5 43a}, 
iea7 £ The moments the signals are sent 
from the sources A and & are not timed 
When the messages, one from each source, 
overlap, they are distorted Find (1) the 
probanhty A that at least one message will 
be distorted (completely or partially), (2) 
the probability that no more than 10 per 
cent of each message will be distorted, (3) 
the distribution function of the random 
variable Z which 1s the “length of the dis- 
Fig 5.42 torted text”, (4) the average length of the 

distorted text z 

Solution. Assume that the @ axis (sce Fig 5 43a) overlaps the A-ax1 
at random Since the beginnings and the ends of the messages are 1 
functional relations, it 1s sufficrent to consider only one pair of adjacet 
segmentsonthe A axis, e 1, the message, and Z,theinterval (Fig 5 439) 








4 i i if £ F(z? 
eee "ey 
fr é f t i é 

ee EN 

(2) 
—A 
é i é (c} 
fa) 
Fig 5 43 


We take the beginning of the interval Z on the A-axis as the reference 
Point and denote the abseissa of the bemmmning of the nearest interval t 
on the &-axis by X. The variable X is distributed with constant density 
on the interval Z + 2, The messages will not evidently overlap when 
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| L< X <L; the probability of this event is 
p=(b—)IL +), R=1—ppo=1—C—)ML +). 


To calculate the probability p that the messages will overlap by no 
more than 10 per cent, we must increase the interval L — /, which is 
favourable to nonoverlapping, by two intervals of length 0.4/. Hence 
L—-l+2x041 =L—0.8l;p = (L—0.8)/L + 1). The random 
variable Z, the fraction of the distorted messages, is a mixed quantity. 
For z = 0 it has a nonzero probability p, = (L — Di(L + 1); for O< 
z<1 we have F(s) =(L—1 (1 —2z)I/(L +1); for z= 1 this 
expression becomes unity: / (4) = 1, and between z =O and z = i 
it increases linearly (Fig. 5.43c). . 

The mean value of the random variable Z is equal to the area hatched 
in Fig. 5.438c, ie. z= (1 —-(L—I/(L 4+ JI/2 = WL + 1). 

5.44. There is a continuous random variable X with density f (x) 
(Fig. 5.442). The observed value of the random variable is retained if 





Fig. 5.44 


it falls on the interval (v,, 2.) and is rejected if it falls outside of the 
interval (z,, x,). A new random variable X (a “shortened” random vari- 
able) results with a range of values from z, to x. Find the probability 
density function f (x) of the random variable X. 

Solution. The sought-for density f (xz) is the conditional density of 
the variable X provided that it falls on the interval (z,, z,). Let us cal- 


culate the probability element f (x) dz for the interval (z, e+ dr) c 
(t;, 2) (see Fig. 5.44a). By the multiplication rule of probabilities 


jf (x) dx = P {X € (x, x)} f (x) da, 


Where f (x) dx, the conditional probability element, is the probability 
that the variable X falls on the interval (a, 2 + dx) under the condi- 
lion that X € (z,, z,), and 


[Xz 


PIX E(, ed} = | f(a) de Fe)=s(@)| | t(ayax. 


x1 
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The curve off (x) 1s similar to that of f{z) and can be found from it by 
dividing each ordinate by the area hatched in Fig 5 44D (see the thick 


curse in Fig 5445) Qutstde of the interval (x,, z,) f (@) = 0 
5.45 A woman states ‘My husband 18 of medium height, but mest 
men are below medium height” Js the statement meaningless? 
Solution The statement is not meaningless and can even ba tre 
if the distrzbution density of the heights of X men 1s asymmetric about 
the mean value (expectation) as shown, for example, in Fig 545 The 
area hatched in Fig 5 45 18 equal to the average fraction of men below 
the medium height m,, and it 3 
larger than the area left unhatched 
F(z) 5 46 Inthe theory dealing with 
the relrability of devices, Welbull’s 
distribution, which bas a distribu 
tlon function 


F(zy)=i—e-"(2>0), 64) 


where @ => Ois a conatant and #182 
positive integer, 18 often used as the 
distribution of the time of fatlure frea performance of the device Find ( 
the probability density function f (z) (2) the mean valve and variance 
of tbe random varlable X which has a Weibull distribution 
clution 


(1) f(x) dF (2)/dz = nas tenor” 


o> 


o Ma 
Fig 3545 


(2) M(X] = | znaz” te-e=" de 
0 
We make a change of the variable thus az"=y, 2=—a~tinyll 
f-na 


— 1 tsa, na 
dX = — O Lina a di. 


i-n 


' f i ion 
M(X]= | nyov am yw dy 
0 


| 

ar 

3 [- 
ory F 


yt ctdyar(i-t)aw 


where [{z} = cto dz ig the gamma function. 
0 


hE [x7] = j nor tg~ ax" ar 
G 


Ch. 5. Continuous and Mixed Random Variables 141 


0 
Var [XJ] = a-2/" (T (1 4-2/n) — {T (1-4 1/n)}*]. 

5.47. The service life of a device is a random variable 7 with den- 
sity f (t) ({ > 0). At a moment ¢), provided that the device has not 
failed, a preventive maintenance is performed, and then it operates for 
a time 7, with density f, (t). If the device fails at a moment y< fg, 
an emergency repair is immediately carried out, and then the device 
operates for a random time 7’, with density f, (¢) (no more repairs are 
made). Find the mean value © of the time for which the device will 
operate, excluding the time needed for the repairs). 


Solution. Let 7 assume a value t{<‘t). On this hypothesis, the 
conditional expectation of the variable e) is M[O| ¢7}-=-t+m,, where 


Ny = [ tf, (t) dt is the mean value of the operating time of the device 
0 
after a repair. Now if t >t), then the device will not fall till the mo- 


ment fy, and M[O| 4] =t,-++m,, where m,= \ tf, (t) dt. Consequently, 
0 

~i-+m,, for t<fp, 

Eyt+m, for t>t. 

The total se? expectation of the quantity 


MIOld={ 


M [0] = Fustma senate | tabmy f(a 
: to 
0 


= | f(Qat+m, [700 at Got j f(t) at 
Q 
t 


= | tf) dt m,P {7 < ty} + (tom) PAT > ty} 


to 


= | tf (t) dt 4- mF (to) + (to-+ my) (1—F (é), 
0 
Where F,(¢) is the distribution function of the random variable 7: 


t 
F(t)= \ f(t)dt. 
0 
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5 48 A sequence of messiges of the same length ? are transmitted 
over a radio channel (Fig 5 48a) with random intervals 7, Tf, 
between them The intervals 7, 7, have the same distribution 
A noise interferes with a message from time to time (5 48b}) The moments 
when the notse begins and ends are not connected with the «equence of 
the messaves Thea duration D of each interference period 1s accidental 
and has an exponential distribution with parameter p the duration 
of an interval between interference periods is also accidental and has 
an exponential distribution with parameter vy Uf the interference period 


é ‘i fc rz '; 
Np perry A 
? a) A 
ofS ‘2 i oD 
iH, Fe pA, iy a , 
tt et 
, (b} 
Tig 5 48 


lasts 25 long 4s a message or a part of it then either the whole message 
or 1t8 corresponding part 18 disterted Find the average length of ihe 
messace distorted by interferences 1e the ratio of the average length 
of the distorted text to the average lengih of the transmitted text 

Solution 1/p 1s the average length of the interference 1/v 18 the 
average length of the interval hetween them the average fraction of 
the time on the ¢ axts occupied by the interferences 1s 


ff ¥ 


fie ie 
It 1s evident that the same average fraction of the messages wil] be dis- 
torted by the interference irrespective of the distributions of their dt 
ration ond the length of the inter 


Tt vals between them if » — 1/M [DI 

see Aenean eee v= t/M [7] 
? é cn 549 During a time t (an obser 
vition period) a signal arrives with 
Pig 549 probability p The signal appears at 


any port af the interval + with the 
Same probability density It 1s known that at the moment t<<T 
(Fig 5 49) the signa) has not yet arrived Find the probability @ that 
ui will arrive during the remaining dime tT — ¢ 
Solution @ is simply the conditional probability that the signal 
will arrive during the trme t — # if tt is known that by the moment ?# 
it has not yet arrived The total probability p of the arrival of the 51g 
nal during the time vr ts equal to the probability ¢p/v that iat will arrive 
during the time ¢ plus the Probability 1 — tp/t that it will not arrive 
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during that time, multiplied by Q. Hence 
ne: t __ p(t—t/t) 
p=zpt(t~pp)Q@; Q=FR. 


9.00, The moment a signal arrives is a random variable 7 with den- 
sity f (¢). At a moment ¢< Tt the signal has not yet arrived. Find the 
probability that it will arrive during the next time interval from ¢ to 
t (Fig. 5.50). 

Solution. The problem is similar to the preceding one. We designate. 
as p the probability that the signal will arrive during the time tT, p = 
T 


\f (t) dt. Reasoning as in the preceding f(t) 








0 

problem, we find the total probability p 

of the arrival of the signal during the 

time t. It is equal to the probability p, 

that the signal will arrive by the mo- Ff t 
t 





ment ¢, l.e. py = f (i) dt, plus the prob- Fig. 9.00 


0 
ability of the complementary event 1 — p, multiplied by the condi- 
tional probability @ that the signal will arrive during the remaining- 
time (t — ¢), i.e. 


T t t 
Viat=\sQa+fi—f smatia, 
0 0 0 


whence 


i—F(@) ~  i—F@.” 
1—{ f(t) at ) ne ie 
0 


Where F (¢) is the distribution function of the random variable T. 
7 } (t) 4 ah exponential distribution with parameter 4, then QO = 
= | — e- AG—t). 

9.01, Under the conditions of the preceding problem f (¢) is a normal 
distribution with parameters m and o: t = m (i.e. the signal does not 
arrive during a time m)*), Find the probability that it will arrive during 
an interval of length o starting at ¢ = m. 

Solution. t=m-o, 


M+O 
_ Q % 0.341/0.5 = 0.682. 


*) The problem is meaningful only if 7 is nonnegative, i.e. for m — 3¢ > 0. 


CHAPTER 6 


Systems of Random Variables 
(Random Vectors} 


60 Asystem of two random variables {X, Y} can be geometrically interpreted 
aaa random potnt with coordinates {X Y) onthe z y plane (Fig 6 9 1) or a9 a ran 
dom vector directed from the origin 16 the point (X, 7} whose components are tat 
dom variables X and ¥ (Fig 602 

A system of three random variables (X Y 2Z) 1s represented by a random potat 
ora random irctor ina three dimensional space, while a system of n random variables 





Tig GOf 


(X, Xq X,,) ts represented hy a random point or a random vector in ant dimen 
atenal space 

The joint probability distribution of two random vanables (X, ¥)}{or the prob 
ability distripution of a system of two random variables) 19 the probability that 
both inequalities X <t x and Y <t y are simultaneously satished, 1¢ 


Fiz,yy=P EA ta Y <y} (6 9 4} 


F(z y) can beinterpreted goometrically as the probability of a random point (X, ¥) 
falling ina quadrant whose vertex ts (zr y) the one hatched in Fie 693 The prob 





\ Fig 603 Fig 604 


wWbihty ok 4 Tandom point ix Y) falling ma rectangle fi Whose qzae9 are parallel 
ita the coordinate axes and which includes its lower aud left-hand boundaries a0 
des not include the upper and mght hand houndartes (Fig 6 0 4} 13 expressed 10 
ae of a distribution function hy the formula 


PUR YIERLSP (§.51— Fie,d,— Pi w+ Rig wy (602) 


, rhe distribution function F (z y) possesses the propertues (4) F (—™, ren = 
7 Oy Zz, 0a} = 0, (2) F {+-00, oj f{, F (z, +o 
i), F(teo, yp= F; uh where F, (r} and ¥, (y) aro the distmbutaot func- 

te of the random yariables X and Y, (4) F (r, y) is a nondecreasing function ° 

> Marennents z and y, (5) F {z, vy) 14 continuous on the left with respect to each co- 


_— 


Ch. 6. Systems of Random Variables 149 


ordinate, (6) F (B, 8) — F (@, 5) — F 8, ¥) + F G@, 2 0 for any << B, YS 
§ (the last property means that the probability of falling in a rectangle is non- 
negative). a 

The joint probability density of two continuous random variables (or the distri- 
bution density of a system) is the limit of the ratio of the probability of a random 
point falling in an element of a plane Az, Ay, adjoining the point (z, y), to the area 
of the element when its dimensions Az, Ay tend to zero. The joint density can be 
expressed in terms of the joint probability distribution, 1.e. 


f(z, y) = @F (z, ylax ay = Po sey (x, y) (6.0.3) 


i.e. js the second mixed partial derivative of the distribution function with respect 
to the two arguments. 
The surface representing the function f (x, y) is known as the distribution surface. 
An element of probability for a system of two random variables is the quantity 
f (x, y) dx dy which is an approximate expression for the probability of the random 
point (x, sf falling in an elementary rectangle with sides dz and dy adjoining the 
point (x, y). 


The probability of a random point (X, Y) falling in an arbitrary domain D 
is expressed by the formula 


P {(X, YE DJ = \ f (x, y) dx dy. (6.0.4) 
D) 


The properties of a joint probability density: 


(1) f(z, y)2>0 and = (2) \ \ f (x, y) dx dy=1. 


—~ OO 


__ The joint probability distribution function can be expressed in terms of the 
joint density thus: 


x oy 
Fe. n=\ | fe, yazay. (6.0.5) 


The probability densities of the separate variables entering into a system can 
be expressed in terms of the joint density, i.e. 


oo 


A= \ iene, Ao=) fe, waz. (6.0.6) 
— xd — 0S 
The conditional distribution of a random yariable entering into a system is its 


distribution calculated under the condition that the other random variable has 
assumed a definite value. 


The conditional distribution functions of two random variables X and Yina 


system are designated as F, (x | y) and F, (y | x), and the conditional probabilit 
densities as fy (@z | y) and f, (y | =z). " ' 


There is a theorem on the multiplication of probability densities, i.e. 


I@y=fi@)feyisz) or f@y=fewh ly). (6.0.7) 


The expressions for conditional densities in terms of absolute densities are 


_ tle, 
hil=LED tor ie) #0, hile = LEY for jay) #0. (6.08) 


100575 
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The random variables X, Y are said to be mutually independent if the cond:tior- 
al probability distribution of one does not depend on the yalue of the other vu, 


Adzly=—f@) or fa fy lz) = fe (6 09) 
For independent random vanables the multiplication theorem assumes the 
form 

Ampere w {6 0 10} 
The moment of order k -}- s about the origin of the system (X, Y) 1s a quanti? 
an, [X, YP] = M[X* ¥4] {6 0 44} 

The central moment of order k + ¢ Of system (X, Y) is a quantity 
yin iX, VE= M {Xk y3} {84 42) 


Formulas for calculating moments 
(a} for discrete random variables 


tas [X, Y= >) Dy egypPeys (6 0 13) 
it 3 

Hes LX, Y= D) Dy (ere ms)* (yy my} Bis, (6014 
i} 


whera py = P {X = 2; Y = gy}, 
th) for continueus random variables 


oo 


ra[X Y= | { aryty (2, uv dz dy, (6.0 15) 
pee(X, Y=} | @—mas@—~my)* f(s, vdzdy, (6.019 


where f(z y) 1s a joint probability density 

ihe order Of the moment «,,{X, ¥] or pa, [X Y] is the sum of the indices 4 
And s 

The cevariance of two random variables ¥, Y is a second order mixed central 
moment, te py, 


Covey = pur (X, Y] = M [XY] (6 0 17} 


It is convenient to calculate the quantity Cov,,. mn terms of the second mixed mo- 
ment sbeut the origin 


Covy, = ty (1X, ¥] — mm, (6 0 18) 
OT, usitg another notatron, 
Cov,, = MEX Y] —M [X] M [Y] (6 0 19} 


For independent random vyanables the covariance 13 zero 
The correlation coefficient (or the normalized covariance) rxy offwo random Vérla~ 
bles X and Y is a dimengonless quantity 


r (X,Y) = ray = Covazy/(txcy), (6 0 20) 
where g.= ]/ Var, = ¥ to ld, Y] and o,= V Var, = )/ ye [4, ¥]} 


The correlation coefficsent is a measure of how closely the random variables are 
dinearly related . 
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Two random variables X and Y are said to be uncorrelated if their covariance or 
the correlation coefficient, which is the same thing, is zero. 

If two random variables are independent, then they are uncorrelated, but if they 
are uncorrelated, they are not necessarily independent. 

If the random variables X and Y are linearly related, i.e. Y = aX + b, where 
aand ) are nonrandom, then their correlation coefficient r,,, is + 1, where the plus 
sign or the minus sign corresponds to the sign of the coefficient a. For any two ran- 
dom variables | ry, |< 14. 

The joint distribution function of n random variables X,, X., ..., X, is the prob- 

ability that n inequalities of the form X; < z; are satisfied simultaneously, i.e, 


F (Z1, Layers ) = Pp {X, <= 71, Xo <—_ Loy occ, An <— Le (6.0.21) 


The joint probability density of n random variables is the nth mixed partial de- 
rivative of the distribution function 
ot 


et e#e#e Zz Se 
I (21s Za, » Zn) Ox, dZq, «++, ALy 


F (2, , Loy aaey Ly). (6.0.22) 
The distribution function F;(z;) of one of the variables X;, entering into the system, 
results from F (xy, xg, ..., Z,), if all the arguments, except for z;, are equal to ++ co 

FF, (a3) = F (+00, boo, ..., 3, +O, ..., foo}, (6.0.23} 


The probability density of a variable X;, entering into the system (X,, Xo, ..., 
X,), can be expressed in terms of the joint probability density by the formula 


(n—1) 
fi(z)= \ ies \ Fes, Woy sory Ty) dz, ... ATi, dxjy, ... dzn. (6.0 24) 


The probability density of a subsystem (Xj, Xo, ..., X,), entering into the system 
Xi Xe; ooey Xp; Xp Hy oes Xy,); 1S 


c (n-k) 
hh se R (x, | rp) = \ eoe \ f(z, sve, Uh, tt ey Zn) Arp 44 eee AZ). (6.0.25) 


The conditional probability density of the subsystem » OF 


veey AXpy W 
other random variables are fixed, is ky When all the 


fi, wee R (x1, i Tr ITho1, las tq) = —— Las Hay ons) tn) (6.0.26) 


Tht, oan (They, one, Zp) * 
If the random variables (X,, Xo, ..., X,) are mutually independent, then 
f (@1, Fay +209 Tp) = Fy (71) Fe (Zo), «s., da (Gy): (6.0.27) 


The probability of a random point (X,, Xo, ..., X.) falling j sae : 
omain D is expressed by an n-tuple integral, ie. ) falling in an n-dimensional 


nr 


P {(X, ecg An)€ D}= \ \ F(a, seey Zp) dx, tae azn. (6.0.28) 
D 


The correlation matriz of a system of n random varj 
. dace : iables (X;, X Xx n- 
tains the pairwise covariances of all the variables, i.e. (Kay Xa on, n) CO 


Cove; Covag een Coven ta 


° . * ® e ® ° r e ° ’ 


- Covn; Covng ... Covan 
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where Covy, = Covij,) = M [XyXq) is the covariance of the random vanable — 
x; & 

' che eatrelation matrix fs symmetric (Covyy = Covy) and, therefore, onfy 
half the table is usually filled 


Cov,, Cov, Coviy 


. * + © & 


Covnn, 


The variances of the random variables X, Xa, » Ap, lia along the principal 
diagonal of the correlation matmx ie 


Cov,,; == Var [X,] (5 9 29) 
The normalized correlation matriz of a system of m randow variables is com- 
plied from the parrwise correlation coefficients of ali the variables, ia 
orig Tas + Fin 
1 Pay Tan 
livaz [= { Fan |i 


i 


where r;, = Cov,;/(a; o)) 13 the coefficient of correlation of two variables Ay, Xp 
The normat probailty distribution of two random variables X, Y {the normal 
distribution on a plane} has a probability density of the form 


i 4 (r—my}* 
I, a a Ce a Rl 


a? (== —— TH =r 

Seas en) em v |} , (8 0 30) 
Oxdy oY 

where m,, mM, ate the maan values of the tandom vanables X, Y, Gy, Ty are their 
mean stuare deviations, and ria therr correlation coefficient 

For random vanables, which have a normal distribution, uncorrelation 13 equiy’ 
alent to independence If the random variables X, FY ara vucorrelated (indepen 
dent), then = 0 and 


i 1 —-mx}? , (¥—my)? 
Ne N= gas, eo {~ [SSE t—— |}. eo 


Fn this case the Or and Oy axes aro called the principal ares of seatiering (disper 


ston) If, m addition m, = m, = 0, the normal distribution assumes a * monica! 
OFT 


-—_! x 6 032) 


The probability that a random point which has a normal distribution will fall 
in & rectangle AR with sides parallel to the princtpal axes of scattering (s#8 
1S '» 


P(x, Y)€ R} ; 
-[o(22)—0( 522)][0(S24)—0( 24). om 


The ellipse of equal probability denstiy (dispersion ellipse) is an ellspse at whose 
all points the fot probability density of the normal ft cibation is constant 
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f (x, y) = const. The semi-axes of the ellipse are proportional to o, and oy: a = 
ko, and b = koy. ae ; 
The probability that a random point which has a normal distribution will fal 
in a domain £, bounded by an ellipse of scattering with the semi-axes a and 6 is 
P {(X, Y)€ Ep} = 1 —e 2, (6.0.34) 
where k is the size of the semi-axes of the ellipse in the mean square deviations, 
ie. k = aloy = b/oy. — a 
If o, = 6, = 6, then the normally distributed scattering is called circular. 
For a circular normal scattering with m, = m, = 0 the distance R from the point 
(X, Y) to the origin (the centre of scattering) has a Rayleigh distribution: 
72 


fr=—s e 2? for r>0. (6.0.35) 


For the independent random variables (X, Y, Z) the normal probability dis- 
tribution in a three-dimensional space is 


4 
—- (211)8/2 O xO0yOz 


xexp{—4 [emma OTR | eam Th 6.0.39 


—- t 3 


f(z, y, 2) 


The probability that a random point (X, Y, Z) will fallin a domain E; bounded 
by an ellipsoid of equal probability density with semi-axes a = ko,, b = kGy, 
¢ = ko, is 


P {(X, Y, Z) € Ex} = 20 (bh) — V 2a ke"*. (6.0.37) 


Problems and Exercises 


6.1. Two messages are being transmitted, each of which independent - 
ly of the other, may be distorted or not. The probability of an event 
A = {a message is distorted} for the first message is P 1, for the second 


is pp. We consider a system of two random variables (X, Y) defined 
as follows: 


Bs 1, if the first message is distorted; 
— { 0, if the first message is not distorted: 
y= 1, if the second message is distorted; 

i { Q, if the second message is not distorted 


(x a Y are the indicators of the event A in the first and the second 
Tial). 


Find the joint probability distribution of the pair of random vari- 
ables (X, Y), i.e. the set of probabilities Pi; for every combination of 
their values. Find the joint probability distribution function F (z, y). 

Solution. The joint probability distribution is defined by the prob- 


abilities 
Poo=P{X=0, Y =0}= 4190, Po=P{X=1, Y¥ =0}= pigs, 
Pa=P{X=0,¥=1}=gp2, py=P{X=1, Y=1}=pm. 
Where g,=41— p,, q2= 1— pe (see the table below). 
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The probability distribution on the x,y plane is concentrated at four 
points with coordinates (0, 0}, (0, 1}, (1, O, Cf, 1) Hig G1) Using 
the geometric interpretation of the probab:lity distribution functron as 


, Grr P Ps 
eke gg A pe —* 





D Py Ge 
G49 fx 


Fig 61 Tig 62 





the probabrlity that a point will fall in a quadrant whose vertex 1s 4 


the point (z, y} (see Fig 60 3}, we get the following table of values 
for F (x, ¥) 


| i<* 

yO | g | 0 | 0 
O<y<s i | Q | 4,44 | q4 
{<“<y | {h | a, | | 





62 The distribution function of a system of two random vartrables 
(X, Y}is F (@, y) Find the probability that the random point (X, ¥) 
will fall in the domain D (Fig 6 2), which is bounded by the abscissa & 
on the right and by the ordinates y, § from above and from below 

Answer P {(X, Y) ED} = F (a, 6) - F (a, ¥) 
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6.3. There are two independent random variables X and Y, each of 
which has an exponential distribution, i.e. 


fy(z)=Ae-* (cx >0), f(y) = pe“ (y > 0). 


Write expressions (1) for the joint probability density, and (2) for the 
distribution function of the system (X, Y). 
Answer. 


, forz<<(Oor y<(O, 
(1) 7(@ y= Ape-Gx+hy) fora >Oand y>O0, 
for x<0 ory< JO, 
Q) Fle W=14_ 9-a (oom 
(4—e-4*)(1—e-H”) for x>Oand y>0. 
6.4. A system of random variables (X, Y) is distributed with a con- 


stant density inside a square R with side a (Fig. 6.4a). Write an ex- 
pression for the probability density function f (z, y). Construct the 


F(z, y) 





Fig. 6.4 


distribution function of the system. Write expressions for /, (x) and 


f, (y). Find out whether the random variables X and Y are independent 
or not. 


1/a2 for (zx, y) ER, 
0 for (xz, y) ER, 

0 for x<0 ory <0, 
zsyla® for O<r<aand0<y<a, 
yla for xz>a and 0<y< a, 
xla for O<x<aandy>a, 
| { for z>a and y>>a. 

The surface F (x, y) is shown in Fig. 6.40. 


_ {/a for 2x€(0, a), t/a for y€(0, a), 
Ae={o, for 2x4(0, a), Ie N={ for yé€(0, a). 


Answer. f (2, y)= 


F(z, y)= 
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The random variables X and Y are independent since 


fmyp=Lohwy 


6.5 <A disimbuation surface of a system of random vatiables (X, ¥) 
is aright cone (Fig 6 Sa} whose base is & exrcle A wrth centre at the 
origin and radius r, Outside the circle the joint probability density 
function f iz, y} is toro (ft) Write the expression for f (z, y}, (2) find 
A, (), fo &), fe (y | x) and f, (x [y), (3) find out whether X and Y are 
dependent and (4) find out whether X and Y are correlated 

olution 


3 ——~ 
(1) 7 (2, Yu) ={ ag Fo Ve*+yP for 24+ <r, 
v for a? Ly? > rb, 


ri Oe f ae | 
(2) fy (ay ad ms [te VF a? In (EE ) [for ta] <r 
4 — a 
' for |z]>Ty 


he (ty) = 


rg Fi 


——-— a er | 
{7 pro Ve In (ZOE EGY YI far ly <P os 
Q for yl Ps 


Furthermore for jx} <r, 





eo oo for iy) <c Vré— 2, 
—_——_ ; a 
fa (yla) = {to V rie in (a) 
for yf Vr 
and for ly| <r, 
tt for Inp< Vr 
i (zly)= rg yYr—y—y In ( ro-t via } 
° for [a}>Vricye 


(3) since f, (¢ | y) 5< f, @), the variables X and Y are dependent, 
(4) we find the covariance Coy., Since m, = m, = 0, we have 


Cov, = ( | zuf (z, y)dady 
ks 


= | lz yf te, ydxdy+ | \ auf (2, y)dady, 
(Ai) Cita) 


where K, 1s the right half of the circle, K, 15 the left half (Fig 6 55), 
the function zy f (@, y) 1s odd with respect to the argument x and, there- 
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fore, the integrals with respect to K, and K, differ only in sign. Hence, 

when the integrals are summed, they cancel each other, and Cov,, = 0 

The random variables X and Y are not correlated therefore. . . 
6.6. A pair of random variables (X, Y) has a joint probability density 


f(x, y) = a/d + 2? + xy? + y’”). 


(1) Find the coefficient a, (2) find out whether the random variables X 
and Y are dependent; find /, (x) and f, (y), (3) find the probability that 





Fig. 6.5 Fig. 6.6 


the random point (X, Y) will fall in the square A whose centre coin- 
cides with the origin and whose sides are parallel to the coordinate axes 
and are 6b = 2 in length (Fig. 6.6). 

Solution. (1) From the condition 


Oo 


| \ fle, y)de dy=1 


~ OX 


we find that @ = 4/n?. 
(2) The random variables X and Y are independent: 


h@= cage hW=zap f=) fly) 


1 4 
‘ - dx dy ee 
(3) P {X;, Y) e R} — ) ) 12 (1-2?) (1+ y?) Re 

6.7. There are two independent random variables X and Y. The ran-— 
dom variable A has a normal distribution with parameters m, = 0 
and o, = 1// 2. The random variable Y has a uniform distribution on 
the interval (0, 1). Write the expressions for the joint probability density 
3 } (z, y) and the distribution function F (z, y) of the system 
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Answer. 


f(z, =F 





e~*” for yeé(0, 4), 


a. 
0 for ys 0, 
F(z, dm [uoV +4 5] for O<cy <4, 
D(z VY 2)-+05 for y>t 


68 The probability distribution surface f (x, y) of a system of two 
candom variables (X, ¥415 a tight circular cylinder, the centre of whose 
base coincides with the origin (Fig 6 82) and whose altitude 13 Find 


fir y} 





Fig 68 


the radius r of the cylinder, as well as f, (2), fs (v), fe 2] fa | ED 
ay, Vary, and Cov,, 


Solution The radius r of the cylinder can be found from the con 


rd 


dition that the volume of the cylinder is unity, whence r = }/ t/(x4) 
The Jomt probability density 
f(z, y= to. 


Wo ogt*#ty?r’. 


Consequently 
- ie 
2YVr2—22h for |z] <r, 
} 2) == Zs i =| 
Ce)= | He vay ; for [zl 
Similarly 


_QVRSRA tor Wyh<r, 
haw) | 0 for [fy|c>r 


‘The graph of the function f, (zr) 1s shown in Fig 686 For jy [<r 
tte have 


4 ——— 
Sess for [zl cc VY r’*—y. 
jeinm Hep [AVES he HI<V AS 


0 for |z]/>Vr—y* 
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Similarly, for |x ]<7r, we have 
1/(2 V r?— 2?) for < VY r?— 22, 
fa(ulz) =| ( V ) ly] fase 
¢ for |y| >> Vr?—2?. 


The mean values are zero, i.e. m, = m, = 0, since the function 
f{ (z, y) is even with respect to both z and y, viz. 
r 
97 5 Tt r 
Var, = 2h \ oY RPoedeahrtt—t, op=t, Covy=0. 
=-r 
6.9. A random point (X, Y) has a constant probability distribution 
density inside the square AR hatched in Fig. 6.92. Write an expression 





{i(2) f,(xly) 
tT oO Tf loi? 0 lol 
(b) (c) 
Fig. 6.9 


for the joint probability density function f(z, y). Find the expressions for 
the distribution densities f, (x) and f, (y) of individual variables X 
and Y entering into the system. Write the expressions for the conditional 
probability densities /, (x | y) and f, (y |x). Are the random variables 
X and Y dependent? Are they correlated? 

Solution. The area of the square is equal to two, and therefore 


1/2 for (x, y)ER, 
i (z, n={ QO for (z, y)GR. 


1-—x 
| \ dy=1-—-xz for 0O<2z< 1. 
—(1i-x) 
L+-x 
dy=-i+az for —1<z2<(Q, 


2, 
—(1+.) 
0 for z<—1orzr>1, 





fy (x)= 


or, briefly, ; 
or [zj<1, 


{—|z| 
fale)=| 0 for |z|>>1. 


A graph of the probability density function f, (z) is shown in Fic. 6.9 
(Simpson's distribution). Similarly, 1 @) Ig. 0.95 


1— f 
fav) =| or jyj<i, 


for |y| > 14. 
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Furthermore, for | y |<< f, we have 


4 

tay) fae for: fel <ci—tyl, 
rly) = of 2(f—~|y]) 

fy (ly) i, ty) 3 for |zj]>1—[y¥] 


Aegraph of the probability density function /, (x | y} 1s shown 1n Fig. 6 de. 
Similarly, for [x |<< 1, we have 


i 
fo ile) = | EY for ly] <z f jz], 
0 for fyfr>1i— [zl]. 
The random variables XY and Y are dependent but not correlated 


6.10 The joint probabiltty density of two random variables X and 
Y 1s given by the formula 





f(z. v= sex exe { —zag Mz 2P— 1 2(e@—2) VA D+ +I 


Find the correlation coefficient of the variables X and Y. 

Answer. Puy “= 0% 

G.ii A system of random variables (X, Y) has a distribution witb 
a probality density f fz, y) Express the probabilities of the follow- 
ing events tn terms of the probability density f (x, y} (1) {X > Y}, 
(2) {AX > 1 Y |}, (8) {) X [> Y} and (4) {¥ — X > 4} 





NN SN (a) 


Solution. The domains D,, Ds, Ds, D4 corresponding to the occur- 
rence of events 1-4 are hatched in Fig 64402 d Tho probabilities of 
points falling mn these domains are 


(1) P{X>Y}= [ | te, ydeay, 


mo = 
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x 


(2) P{X>1V}=J | f@, ydady, 
0 - 


x 


co jx 
(3) PIX] >Y}= ) | #@, y)dedy, 
(4)P(Y—X>1}= | | fl, yardy. 


—oo x-+/1 


6.12. A system of two random variables X and Y has a normal dis- 
tribution with parameters m, = m, = 0; o, = Gy =o and rx, = 0. 





Yok J 
IN : Mp Wy) : 
KC TT 
(5) (C) 


Find the probabilities of 
A={\Y|<X), B={Y<X} and C= {(V<]X}. 


Solution. Fig. 6.12ashows the domains corresponding to the events A, 
B and C. For circular scattering the probabilities of the events are 
; (A) = 0.25, P (B) = 0.5, and P (C)= 
6.13. A random variable X has a 
probability density function f (x), and 
a random variable Y is in a functional 
relation with it: Y = X*. Find the 
distribution function F(z, y) of the 
System (X, Y). 

Solution. Since the value of Y is com- Fie. 6.43 
pletely defined by the value of X, the nes 
random point (X, Y) can only lie on 
the curve y = 2°. The probability that it will fall in a quadrant 
With vertex at the point (z, y) is equal to the probability that the 
random point will fall on the projection onto the z-axis of a section 
of the curve y = 2° falling in the quadrant (Fig. 6.13). Using this 
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interpretation, we have 


O for yO or y>> Oandr< —YVy, 


Vy 
\ f(zjdz for y>0 and z= Vy, 
f(z, y)= ~Vy 
= 
| f(z)dz for yO and —VYycrs Y/ ye 
-Vu 
6.14, A random point (X, Y) has a normal distribution on a plane 
with parameters m, = 1, m, =~1, ¢, =1, o, =2 and Tey = 0 


Find the probability that the random point wall fall in the domain D 
bounded hy the ellipse (2 — 1)? + (y + 1394 — 1 

Solution. The domain D is bounded by the ellipse of scattering £, 
With the semi-axes q = Oo, = 1 and b = oy = 2, the probability of 
the point falling in this domain p=i-_ elf ae 0 393 

615 Shelis are fired at a point target and destroy everything 
within a circle of radius r The Scattering of the points where the shel} 
lands is circular with parameters My, = my, = 0 and o, =o, = 2 
{the centre of scattering coincides with the target) How many shells 
must be fired in order to destroy the target with probability P = 0 9? 

Salution The probability of destroyine the target with one shel} 
p=1 —e-( 52/2 ~ 0418 The number of shots required 


n => log (1 — P)/log (1 — p) = log 0 i/flog 0 882 ~ 18.4 10 
n= 19 


6 16. A system of three random variables (A, Y,Z)}has a joint prob- 
ability density / (=, ¥, 2) Write expressions (1) for the probabiltty 
density /, (x) of the random variable X, (2)forthe joint probability den- 
sity fas (y 2) of the random vaniables (Y, Z)}, (8) for the cond:tional 
probability density Ia g (¥, 2 |), (4) for the conditional probability 
density f, (y |z 2), (9) for the distribution function F (xz, y, 2), (6) 
for the distmbution function , (x) of the random variable X, (7) for 


the distribution function f,4 (x, y) of the subsystem (X, ¥) 
Answer, 


(1) i= Vf f(z, y, z) dy dz, 


ovr 


2) fas(ysz)= | f(z, y, 2) de, 


@) fal, sl)\—— EB) ye, = — He, 
J) 4 ev 2) dy as § te vs 2) dy 
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x ¥ Zz 


(9) F(z, y, 2) = \ \ \ f (z, Y; Z) dx dy dz, 


x o os 


(6) Pyla)= F(x, 00, 0)= [ | | f(a, 2)de dy ae, 


x fj oO 


(1) Fya(a, =F (x, y,00)= | | | fle, y,2) de dy de. 


—O —co — © 


6.17. A shell is fired at a point airborne target. The point where the 
shell explodes is normally distributed with the centre of scattering at, 
the target. The mean square deviations 0, = 0, = 6, = o. The target. 
is destroyed if the distance from it to the point where the shell explodes. 
does not exceed r, = 20. Find the probability p that the target will 
be destroyed with one shell. 

Solution. Using formula (6.0.37) for the probability that the shell 
falls in an ellipsoid of equal distribution density, we have 


p=P{(X, Y, Z)€£}=20 (2) — Lz 20 oz 0.739. 

6.18. A system of three random variables (X, Y, Z) is distributed 
with a constant density in the interior of a ball of radius r. Find the 
probability that the random point (X, Y, Z) will fall inside a con- 
centric ball of radius r/2. 

Answer. p = 1/8. 

6.19. A ball is drawn from an urn which contains a white, b black 


and ¢c red balls. The random variables X, Y, Z are defined by the follow~ 
Ing conditions: 


yal if a white ball is drawn, 
™~ \O, if a black or a red ball is drawn, 


y — si, if a black ball is drawn, 
~ 1O, if a white or a red ball is drawn, 


7 = 4, if a red ball is drawn, 
~ 10, if a white or a black ball is drawn 


(A, Y, Z are the indicators of the events {a white ball}, {a black ball}, 
{a red ball}). Construct the correlation matrix and normalized corre~ 
lation matrix for the system of random variables X, Y, Z. 

Solution. We find the covariances from the table of probabilities of 
separate values of A, Y and Z. Using the notation 


Paeiu jt =P{X=2, Y= Y3, Z = 24}, 
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we Rave 
Poop = F {xX == {}, Y = 0, Z=O} = 0, 
Poo = P{X = 1, Y= 0, Z=—0} = a/ffe + 64-0), 
Pug = P{A =0, FY = 1, Z2=—]0} = bifa + b + 6), 
Pore P(A =O, Y= 0, Z2=f}—c/la+6+e}, 
Pry9 = Pass = Pots = Poi = 9, 
_ a _ b Fs 
Me=atepe “ey ~Grppe? se apbye’ 
OV ey = 2 (Ty — Mt) (Hy — My) Pay yty 
ig: 
a & a 
=(! — Shere (o— ad bcc apb+e 
Fy b a 
+(0— sat } (1 ~ a} a+tot+e¢ 
a b c mead 
+(0— atte (0- } a-+b--e (a--bpe 
Simtariy 
—He — he 
COVes = apepep * COM Ge peper 


Next we find the variance 
a3 _. 2fs+e} 
Vate= 0 (X]—mi= sop e eye rey thee 
similarly 
Var, = b (a + e)f(a + 5 +c}? and Var, = ¢ (2 + df ter 


The correlation matrix 18 


Vary Cov,, Gov,, 
j} Gov jj) = Var, Cov,, 
Var, 














Ve find the correlation coefficients 
Covey —= ih 





Vey SS ee Oe ee VY as 
V Vary Var, Y ab (a-+ch (ot cj fate} (+c) 
Similarly ° 


at he 


"eV GEA Py? ™!"—V GEayera 
The normalized correlation matrix 15 


1 Psy Pe 
i rif = 1 Fuz 
4 
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6.20. We have a system of random variables X and Y. The random 
variable X has an exponential distribution with parameter A, 1.e. 
f, (c) = he* for x > 0. For a given value X = x >0 the random 
variable Y also has an exponential distribution, but with parameter z, 
ie. fy (y |x) = ze’; for y > 0. Write the joint probability density 
function f (x, y) for X and Y, find the probability density fe (y) of Y, 
and find the conditional probability density /, (x | y). 

Solution. 


Aze~@+tw= for z>0 and y>0, 


f (2; n=| 0 for zs<0 or y<O, 


A 
¢ ———- for > 0 
fe (y) = \ f(x» y) ie | (Ay)? Y 
Q for y<. 


Furthermore, for y 0, we have 


_ tle, yy _f TA+yPe Gt for z>0 
h(ejy= fo (y) =| 0 for gant 


6.21. Given two independent random variables: a continuous random 
variable X with distribution density f, (x) and a discrete random var- 
iable Y with the values y,, Ys, ..+; Yn Which have the probabilities 


Pi; Po, «+ «> Dn- Find the probability distribution function of the system 
of variables X, Y. 


x< 
Answer. F (z, y) = F, (x) F2(y),'where F, (x) = \ i, (x) dz. 
0 
| 0 for YQ 


Ps for ¥4»<l yo; 


eo «§ & oe #8# «© # & $6 % *# @ 


1 for y> Yn: 


6.22. X is a discrete random variable with two values z, and 2, (t_ > 
x) which have probabilities p, and p,. A random variable Y is con- 
tinuous, its conditional distribution for X = z; being normal with 
mean value z; and mean square deviation o (i = 4, 2). 

Find the joint probability distribution function F (z, y) Of the ran- 
dom variables X and Y. Find the probability density function f, (y) 
of Bc random variable Y. 

olution. F(z, yy=P{X <2} P{Y<y]X<a}. liz then 
P{X<z}=0 and F(z, y)=0, assuming 2, ee aa 
P(X<a}=p, and F(a, y)=pyP{¥Y <|X=a)— * 
11-0575 nS 


~ 
— 


Fd 
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-+-0 5 | Using the total probability formula, we have for o> t, 


F(z, v)= ps (25%) 405]+-p, [0 (2%) +0 5] 
Consequently 
0 for x<2, 
F(z, yy= 4 [> (2S*)-+0 5] for 1,.<2<y, 
ps [® (74) -+05]-+2,[¢ (*S=)+05] for 2>z, 


Furthermore, setting x = oo and differentiating with Tespect to y, we 
obtain 





_ te 21 (y=274)}2 


= | Pye 20 pe 20 | 








ad 

fe (Y) = Ze F (00 y= 3 
G 23* The stars in the sky can be regarded as a Poisson field of points 
The number of stars covered by a telescope objective lens 1s a random 
variable which has a Poisson distribution with Parameter As where § 
is the area of the portion of the surface of a unit sphere that can be 
observed through the telescope 

(Fig 6 23a) The view field of the 


y 

telescope has a coordinate grid 

(rhe (Fig 6 23) Show that for an arhit 
rary alignment of the telescope 

£ the coordinates (X, Y) of the star 

nearesf to the cross hairs have 

a normal distribution with param 

¢ (a) (s) 


eters my, = iy = 0 and o,= 
Go, = 1// n2h 
Mg 623 “Solution We showed mn Problem 


919 that the distance A from the 
centre of the cross-hairs to the nearest point in the Poisson field*had a 


Rayleigh distribution But R = X*-+ Y* and, consequently, the 
probability that the point (X, Y)} will fall in a circle D of radius /, 
le P{X*4 Pw r*}, can be written in two forme either 


P 
P{R<r} = \ 2tkre Rar? 7p 


or (6 23 1) 
PUX YED= {| tie ydedy, 
(D) 


Ch. 6. Systems of Random Variables 163 


where f (x, y) is the joint probability density of the variables X, Y. 
By virtue of symmetry, we must assume that f (v, y) depends only on 
the distance, ie. f (xz, y) = g(r), where r= Vx? + y*. If we use 
polar coordinates (r, m), we obtain 


ai r r 
P{(X,Y)€D}= | do | rg(r)dr= 2a [re(r)dr. (6.23.2) 
0 0 0 


Comparing expressions (6.23.1) and (6.23.2), we find that g (r) = Ae“™4” 
and, hence, f (x, y) = Ae7™4@* + y?), and that is what we wished to prove. 
6.24. A source of a-particles is at the origin of a spherical system of 
coordinates (r, , @) (Fig. 6.24), where O < p < 2n, —n/2 CBS a2, 
The particles scatter uniformly in all direc- 
tions. We consider a particle which moves 
in a random direction defined by the angles 
@ and ©. Write the joint probability den- 
sity function f (pg, 0) of the random vari- 
ables M and 0. 
Solution. If the a-particles are scattered 
uniformly in all directions, then a unit Fig. 6.24 
vector e from the origin defines the direc- 
tion of the particle and all its possible endpoints on the sphere C of 
unit radius will have the same probability density. Consequently, the 
element of probability f (p, 3) dp d&@ must be proportional to the 


surface element ds on the sphere C. The surface element is dS = 
dp d? cos 0 whence 


f(g, 8) dp dd = A cos $ dg dd; | (p, 8) = A cos, 


where A is the proportionality factor, which can be determined from 
the condition 





2x 1/2 
\ do \ f(p, 0) dd=14, 
0 —m/2 


and hence A = 4/(4x). Thus 
0<9<2n 
—m2<at<n/2. 


6.25*. On the hypothesis of the preceding problem we consider a 
plane P which is parallel to the equatorial plane (in which the angle 
is read off) and passes through a point O’ which has spherical coordinates 
r=1,9 = 0,t = n/2 (Fig. 6.25). The plane has a system of Cartesian 
coordinates zO’y. All the a-particles which fly in the upper hemisphere 
of the scatter get onto the plane P.We consider one of these particles and 
the corresponding random variables which are the coordinates X 4 


of the point at which the a-particle falls on the plane P. Find the joint 
ite 


i (9, 8) = cos d for 
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probability density function f {z, y} of these random variables Are 
random variwbles X ond Y mutually dependent? 

Solution We scek the probability element f (x, y} dz dy, which 1s 
approumately equal to the probability that the particle will fail 
the surface element dr dy adjoining the 
point {z, y} We calculate this proba 
bility as we did in the preceding prob 
lem We find the area ds of the portion 
of the unit sphere C such that the par 
ticles passing it fall in the surface 
element dz dy This portion 13 tha central 
projection of the surface element dr dy 
onto the sphere € The projection 1 
found by multiplying the surface ele 
ment by the cosine of the angle 0 be 
tween tho direction of projecting and 
the plane P In addition, the surfaces 

Pig 625 decreases in inverse proportion to the 
square of tha distance A fram the centra 
of projection The surface element ds on the sphere C€ 





1 
dg = dz dy cos O a ¥ i424 73 _ dz dy 
rr nie eo) es eT 


To obtain the probability element, we must divide ds by the area of 
the whole upper hemisphere which 1s 2% We obtain 


dzd i 
ie dddas are oT Mea 


The random vatiables X and Y are mutually dependent since their jount 
probability density function does not decompose into the product of 
two functions, one of which depends only on z and the other only on y 





Tig 6 26 


626 Arandom point A represents an object an a circular radar screen 
of unit radius (Fig 6 262) and has a uniform distribution within that 
circle Find the Joint probability density function f (r, @) of the polar 
coordinates (R, ©) of the point A Are the random variables R and ® 
cependent? 
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Solution. Let us consider, in polar coordinates, an elementary “rec- 
tangle’, which corresponds to infinitesimal increments dr, dp of the 
polar coordinates r, @ of the point inside the circle (Fig. 6.260). Its 
area (to within higher-order infinitesimals) is r dr dp. Dividing this by 
the area of the circle, which is equal to x, we get the probability element 


f(r, 9) dr dp = rdrdg/n, 
whence 
f(r, po) =r/n for O<r<i; Ox gp<2n. (6.26.1) 


We find the probability density function f, (r) by integrating (6.26.1) 
in the whole range of variation of q, i.e. 


f(r)= | Ddp=2r for O<r<t. 
0 
Similarly 
1 
f.(p)= | + dr=>— for O<p<2n. 
0 


The graph of the distribution /, (r) is aright triangle (Fig.6. 26c), the graph 
of the distribution f, (p) is uniform over (0, 2m). 

Multiplying f, (r) by f. (p), we get the joint probability density 
} (r, ») of the system (R, M), and consequently, R and ® are independ- 
ent. Note that for the same uniform distribution, the Cartesian coor- 
dinates X, Y of a point in the interior of a circle are mutually depend- 
ent. We proved this while solving Problem 6.8. 

6.27. On the hypothesis of the preceding problem, the radius of the 
screen is not unity but a. Write the expression for the joint probability 
a of the polar coordinates of the point A and their separate den- 
Sities. 

Solution. Dividing the area of the elementary “rectangle” by that of 
the screen xa? and cancelling by dr dy, we obtain 





for O<r<a, 
O<gp<2n, 


2 
Atj=-— for O<r<a, 


f(r )=s3 


4 
fe (9) = 52 for O<cg<2n. 


CHAPTER 7 


Nuinerical Characteristics of Functions 
of Random Variables 


7.0. One of the most efficfant meana of solving probability problems 1s to 12 
numerical characteristics The characteristics of random variables of interest can 
then be found without invoivins ther distributions In particular, it ia not Rete 
aary to know the duatributtens of the funetiona of random variables in order te 
find their characteristics It ta sufficient to koow the distributions of the argument 

Ii X is a Gisereta random variable with an ordered series 


: ii ial al Pi=4} oe 
wal Pr] Pa | 1 pn | “dns 


and the vanables ¥ and X are mua functronal relationship ¥ =m op {X), then ihe 
mean Value of the vatiable Y 1s 


rf" 
my =Mig (X= SY) ole) pp (70.4 
i=i 
and the variance can be expressed) by one of two formulas, either 
Tl 
Vary = Var [p (X= >) le ted my)? py (792) 
iw" 
ore 
fi 
Vary= >) [9 (r)]* p) — 3. (7 9 3) 
{ax} 


If (X, Y} 13 a system of discrete random yarables whose distribution is char- 
actenzed by the probsbilities 


py > P(X = 2, Y = yy), 
and Z2=@(X, Y), then the mean value of Z 13 


ms MC (G(X, VND) DG ets wae Pay, (7 OA} 
i 3 

aud the vatianca can he expresaad by one of the twa farmulag, efther 

Vaty=Var[o(X, Yl= 2) pa Lp ley, vy ans)? pay, (795) 
i 
or 
Vary= 3) (9 en vali asmint (70) 
1 


If X 13 2 continuous random variable with probability denaity f (r), and ¥ = 
¢ (X}, then the mean value of Y uw 


my=M (X= | oie) sla)as, 707 


=— 
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and the variance can be expressed by one of the two formulas, either 


Var, = Var [9 (X)]= \ [p («) — my]? f (z) dz, (7.0.8) 
or . _ 
Vary= \ [@ (x)]? f (x) dr—mj. (7.0.9) 


If (X, Y) is a system of continuous random variables with the joint probability 
density f (x, y), and Z = g (X, Y), then the mean value of Z is 


me=M [9(X, Y=) | o@ wile, vdedy (7.0.40) 


and the variance can be expressed by one of the two formulas, either 


Var,= Var [9(X, Y)]J= \ \ [p (x, y) — mz]*f (x, y) dx dy, (7.0.14) 
or ~~ 
varz= | \ [9 (x, wf (2, 9) dz dy—mb. (7.0.42) 


If (X,, ..., X,) is a system of n continuous random variables with density 
i (zy, . ., 2), and Y =  (Xy, ..., X,), then the mean value of Y is 


my =M [Pp (Xy, ---) Xn)] 


¢ (a) 
— \ ee \ @ (24, eo 09 Ln) f (x, cers Zn) dz, . din, (7.0.43) 


and the variance can be expressed by one of the two formulas, either 
Vary = Var [9 (X,, ..-, Xn)] 


(n) 
~ = \ [P (1, -  » ep)—my)* fF (21, - -» Tn) dry... dzp, (7.0.44) 


= OO =~ OO 
or 
f (n) ° . 
Vary= } ceci \ [p (x1, . ? Ly) \* f (x3, ° ? Ln) dx, “s din—mMj. (7.0.45) 
= 0 = OO 


In some cases, we do not even need to know the distributions of the arguments 
but only their characteristics in order to get the characteristics of functions. Here 
are the fundamental theorems on characteristics. 

1, If ¢ is a nonrandom variable, then 


M{c] = c, Var [ec] = 0. (7.0.46) 
2. If ¢ is a nonrandom variable and X is a random variable, then 
M [eX] = cM [IX] Var [eX] = 8 Var [X] (7.0.47) 
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4 The addition theorem for mean values The mean valve of a sum of random 
partabies ia equal to the sum of thelr mean values 


M[X -+ Y] = MX] + MIY}, (7.0.48) 
end, fa general, 
M[ >) Xy]= 9) MIXy]. (7 0.15) 
imi i=] 


4 The mean value of a linear function of several random y¥aryables 
roi 
Yur) ajXj-+2 
j= i 
where a, and 4 ara nontandom ecefficients is equal to the same hrnear function af 
their Maan values 
Ti fr 
(mys M LD) atX¢-+b] = >) apne, +5 (7 0 20) 
tam] j==1 


where m,, = M [X,] This rule can be written i a concise form v2 
M(L(X, X, X= L£ (ys Me, rts (7 0 21) 


Where Z is a linear function 


5 The mean value of th bles X and Y us er 
pressed {by the formula 6 product of two random yvariabies B 


M(XY] = M (XEM (¥] + Covyy, (7 0 22) 


where Cov,, is the soyanance of the vanables X and Y This formula can be reer’ 
ten ay follaws 


Covzy = M [XY] — rtd (7 0 25) 
ory bearing in mind that M{X¥] = a,plX Y] as 
Covyy = LX YY] — mym,. (7 0.25) 


6 The multiplication theorem for mean values The mean value of the product 
of two uneorrelated random variables X Y ts equal to the produed of their mean patue 


M(XY] = MEX] M[Y] (7 0 25) 


If Xy Xs X,, are independent random variables then the mean value 
of their product is equal to the product of their mean values 


{=f f=1 


#. The variance of the sum of two random vanables 1s expressed by the formula 
Var [X + Y} = Var [X} + Var [¥} + 2Cov,zy. (7 0 27) 


ou, The veriance of the sum of several random variables is expressed by the for 


Fe TE 
Var [> XiJ= 2 Var [X,]+-2 24 Cov 2,2; (7 9 28) 
= —" < 


Where Cov,,., is the covariance of the random variables X, and X; 
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40. The addition theorem for variances. The variance of the sum of two uncorre~ 
lated random variables X and Y is equal to ihe sum of their variances: 


Var [X + Y] = Var [X] + Var [Y], (7.0.29) 
and, in general, for uncorrelated random variables 
Tr Tt 
var [ >) Xi] = >) Var [Xj]. (7.0.80): 
i=1 i=l 


41. The variance of a linear function of several random variables, 1.€. 


Tt 
Y= >) aiX;+b, 


i=1 


where a, and 6 are nonrandom variables, is expressed by the formula 


n n 
Var, = Var [ > a;X;-+b|= >; a? Var [X;]-}-2 > aja; Cov x 5x5 (7.0.31) 
i=l i<j 


i==1 


When the variables X,, Xo, ..-, Xp are uncorrelated, we have 


n nr 
Vary= Var [ >) a;,X;-+b]= >) a? Var [Xi], (7.0.32) 
i=1 


=~ 


42. When several uncorrelated random vectors are added, their covariances are 
added, e.g. if 


xX = Xy -- Xoy i — Y; + Yo} COV 2 2 j — COV. as = Cov, oe COV, x. — Q, 


then 


COV, = COV,. +- COVy, ye" (7.0.33) 
Linearization of functions. The function @ (X,, X., -.., X;,) of several ran- 
dom arguments X,, Xo, ..-, Xp, is said to be almost linear if it can be linearized 
(approximated by a linear function) with an accuracy sufficient for applications 
= _ whole range of the practically possible values of the arguments. This means. 
a 


Th 
oP 

ty (X,, Xo, An) --@ (Trzeys Mxo . mx) Dy (== ‘ (X;— Mss), (7.0.34). 
i=1 

where 

( aM } _ ay (M24 MNXor «+9 mx) 
Ox; nm OX; 
is the partial derivative of the function @ (z,, z zx,) With 
: , ee respect to the 
argument z; in which each argument is replaced by its mean value. 


The mean value of the almost linear function Y = Dera, Crane. ¢ 
approximated by i inear function @ (Aq, Xe, +» A7) can be 


my la (775.45 Mss 3 a (7.0.35) 


The variance of an almost linear function can be approximated by 


nr 
= op \2 ay ay : 
Vary = 2 ( Oz; ) Vars;+22) ( Oz; ) ( OZ; ) Covey x ys (7.0.36) 
i= I<] 
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where Var,, ig the variance of the random variable X, and Cov,,. y is the covariance 
of the random variables X, and X, 


When the random arguments X; XX, X, are uncorrelated, then 


Tt 
Vat y= > (se Y" vers, {7 0.30 
imi 


Problems and Hyrercises 
71 The diserets random variables X has an ordered series 
—1;Gjyi42 
Q2/o1foasfa4 








Find the mean value and variance of the random variable Y = 2* 
Selution my = 24 xX02422 x 0142! x03 +2? k04= 
24 and Var, =o, (YI --mi= (2 9}? 02+ (25? x0 1-4 (2? x0 3+ 

{27 x 04 — 2 4* = 1 99 
72 A continuous random variable X¥ is distributed in the interval 
(0 1} with density / (zr) = 2x for x € (0 1) (Fig 7 2) Find the mean 


value and variance of the square of this random 
variable F = X? 


Solution 


f 
Ny = G,([A] = 2222 dr== 
9 


Var, =a, [¥} — me — 





Ty 


(222d ~(4)"= a 


Fig 72 


73 Arandom variable X has an exponential 
distribution with probability density f (x)= 45 * 


for z >> 0 (A> 0) Find the mean value and variance of the random 
sarlable Y —e * 


Solution 





ity = \ e“Ae 3 dr= 
i 
0 + 


a , 7 
Var, = fe bY] — mi, _— \ oAZesvrzdr — (ty) = a-Pa aD 
0 


74 Arandom variable X has an exponential distribution with pro 
bability density f (x) = te 4 for sO Determine the conditions 
under which the mean value and variance of the random variable ¥ = 
e* exist and find what they are equal to 
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Solution 
My = \ ee Ax dz= iA e~A-1<e dy for A—1>0, 
0 0 
ic. for X>>1 this integral exists and is m,=A/(A—1) for A<1 it 
diverges, 1.€. 


a, [Y]= \ erAe-Ax dx =}, \ e-(4-2)% dx 
0 0 


For 4 > 2 this integral exists and is A/(A — 2) and the variance Var, = 
(id — 2) — [A/(A — 1)]?; for A<2 the integral diverges and the 
variance Var, does not exist. 





Fig. 7.5 Fig. 7.7 Fig. 7.8 


7.0. A random variable X is distributed with probability density 
f (ct) = 0.5 cos x for x € (—x/2, n/2) (Fig. 7.5). Find the mean value 
and variance of the random variable Y = sin X. 


Solution. 
nf2 
ny, =-—> \ sin zcosxzdx=0Q, 
 at/2 
; n/2 
Var, =@,[Y] = > \ sin? x cos x dz=-- : 
{—3t/2 


_ 7.6. A random variable X has the same distribution as in the preced- 
a ae Find the mean value and variance of the random variable 
= |sin X |. 


Solution. 
m/ 2 nx] 2 
fj esio es | |sinzjcosrdz= sin x cos dt =— 
y a : ] een i 

1/2 0 

{ 1/2 t/2 

a {[Yj=— | lsinz |*cosz dx=— sin? cos zdz=—, 

~ 1/2 ( 
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77 Aratdom point (A Y)1s uniformly distributed in the intenor 
of a circle K of radius r = 1 (Tig 77) Find the mean value and van 
ance of the random variable Z = AY 

Solution 


f(z, yy=-i/n for {tz WEA, 
= = { xy dz dy, 


(fi) 
Var, = — \ | xy dz dy 
(A) 
, eit if ‘ 
_—. Beng? z — 
= — dp |r cos? @ sin? p dr 5 
4d 


78 Arandom point (X Y)1s untformly distributed in the interior of 
a square & (Fig 78) Find the mean value and variance of the random 
variable Z => XY 

Solution Sinee the random vanables X and Y are mutually mde 
pendent we have 


in, = ih iy = (1/2) (1/2) = 1/4 
Var, = a, |Z] — m= M [(XY)2]— m2 = M [X2] M[¥2] —m, 
Mi{A*J—=a,(KP— 41/8 MEY*}—4/3, Var, = 7/144 
79 Two random variables X and } axe related as Y = 2— 0X 
The numerical characteristics of the variable X are given,1e m, = —! 
and Var, = 4 Find (1) the mean value and variance of the vartable Y, 
and (2} the covariance and correlation coefficient of the varrables « 


and ¥ 
Solution 


(4) My=l—jm,=d Vary=(~3P x 4-56, 
(2) Cov,y=M (XY ]—mym = M [XxX (2—3Xy 41x 45 
== 2M [X]—~ 3M [X2] +5, 
M [X?] =a, [X] = Var.-+mi=4+1=5 
whence Cov,,= —2—3x5+4+5= — 42 
Py a= ~— 12/ (0,0,) = ~12/ 4x 36 = 1 

which 1s quite natural since X and Y are rn a linear functional relation 
ship with a negative coefficient in X 


710 A system of random variables (A Y Z) has the mean values 
m, m, and m, and the cerrelation matrix 


Var, Gov, Cov,, 
Var, Cov), 
Var, 
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Find the mean value and variance of the random variable U = aX — 
bY + cZ — d. 

Answer. m,, = am, — bmy + cm, — d, Var, == a* Var, + 0°? Vary+ 
c2 Var, — 2ab Covay + Zac Cov —— 2be Cov yee 

7.44. An n-dimensional random vector et (May oh ade a) 
is made up of mrandom variables X; with mean values m,, (i = 1, ..., 
n) and variances Var,, (i = 1, .., 7), and has a normalized cor- 


relation matrix || Tx), l|(gé = 1,2, ..., n, 7 >t). The random vector X 


is transformed into an dkesinell random vector Y¥ = (Y;, Yo... 
Y,,),; the components of the vector Y resulting from the components of the 
vector X upon linear transformations: 


Yp= >) apXitd, ‘k=1,2,...,m)- 
i=1 


ay the characteristics of the random vector Y, i.e. the mean value 
y, (et = 1, ..., m), the variance Var, , (ke = 1, ..., m) and the 


ce of the normalized correlation matrix Il Ty,y, (= 1, 2, - - 


mk<l), 
‘Answer. 


n 
My, = Dy Qip,Ix, + Op (A=1,...,m), 
i=1 


mn 
2 , Tac SPaa. 
Vary, = p ay, Var ' +2 43 Ix V Vars, Var, 
= 3 


Tupy, — Covy,y,/ V Vary, Vary,» 
where 


n 
Covy y; ra 4 hin 2it Var;, 5 pa (24,2; + A 5,031) Mx pty V Vare, Vars ys 
= tn? 


7.12. There are two mutually independent random variables X 
(x—1)2 
and ¥, The variable X has anormal distribution /, (xz) = Vis e 


and the variable Y has a uniform distribution in the interval (0, 2). 
Find (1)M[X + Y], (2)M[XY], (3)M[X?], ()MIX — y*], (5) 


Var [X + Y] and (6) Var [X — Y]. 
Solution, 


(1) M(X + Y] = MIX] +M[¥] =1+4+1=2, 

(2) MIXY] = M[XIM[Y] =1i1xi= 1, 

(3) M [X?] = a, [X] = Var [X] + m2 =4+414 =5, 

4) MIX —~¥4] = MIX] —M[¥v] =1 — a {Y] = —4/3, 
(9) Var (X + Y] = Var [X] + Var [Y] = 4 + 1/3 = 13/3, 
(6) Var [X — Y] = Var [X] + (—1)? Var [Y] = 13/3. 
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7.143 A random variable X has a normal distnbution {{z)= 
i 
i _¢ 20, Find tho mean value of the random yanable Y= 


1—3X2 44X58, 

Solution, m, = M[1— 3X2-+4.443) = 1—3M [X7]-+-4M [X35]. Since 
m,=0, 1 follows that Mj[X2)=0?, for our normal distribution 
AM [X*])=-0, hence m, = 1— do 

7,144, The independent random yariables X and Y have distnbt- 
tions f,(z} and f,(y) the graphs of whose probability density func- 








Fig. 7.14 Fig 716 


trons are shown in Fig 7 14a, & Find (4) M[X-+-¥], (2) Var[ex— 
6Y-+1], (3) M(XY], (4) M(QX¥ —3x24-¥2— 1 
tee MEX] = 2a/3, M[¥] = 6/3, Var[A] = a?/18, Var[{Y]= 


(4) M(X+Y] = (2a+ 63, 

(2) Var [3X —6Y + 1] = 9 Var, +36 Var, = a2/2 - 25%, 

(3) M[AY] == 2ab/9 

(4) M[2XY¥ — 3X74) 2—4]— OM [XY¥|—3e,{[X]+a,{Y]—1 
= 40b/9 — 3a2/2 + bt —14. 


7415 Answer questions 4 3 of the preceding problem given that the 
variables aA and are mutually dependent and their correlation coel- 

cient ry, = — 

Solution. (1) M[X + Y] = (2a + 5)/3, (2) Var [3X — 6Y + tl = 


a2 + 207 +. (36ab/V 18X18) 0 9 42/242b?-+441 8ab, (3) MIXY]= 
2ab/9 — 0 9ab/is = 34ab/180 

7.16. The ends of a ruler AZ of length Z slide along the sides of a right 
angle Oy. The ruler occupies a random position shown in Fig 7 16 with 
all the values of the abscissa X of its end A on the z-ax1s 1n the interval 
from O to / being equally probable Find the mean value of the dis- 
tance A fram the origin to the ruler 

Solution. The random variable X is uniformly distributed 1n the 
interval (0, 2, f (z) = 4/1 for 2 € (0, B The random vamable A can 


be expressed in terms of X (see Fig, 7,16), R= XV1 — (XA). Its 
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mean value 


Mm, = zV1i~ (F)*de=z. 
0 


7.47. The random variables V and U are in a linear relationship with 
the random variables X and Y, ie. V=aX+0Y +c and U= 
dX + fY +g. The numerical characteristics m,, my, Vat, Vary, 
Covx, of the system of the random variables X and Y are known. Find 
the characteristics of the system of random variables V, U, i.e. my, mu, 
Varig Vales. COV eis Tou 

Solution. 


Mm, = amy + bm, +c, Var, = a* Var, + b* Var, + 2ab Covy,, 
my, = dm, + fm, +g, Var, = d Var, + f* Var, + 2df Covyy. 
Furthermore, 
V=aX +byY, U = dX + fY, 
Cov,, = M [VU] = ad Var, + bf Vary + (af + bd) Covy, 
rou = COVpy/ V Vary Vary, 
7.18. An analytical balance is used to weigh an object. The actual 
(unknown) mass of the object is a. Because of errors, the result of each 
weighing is accidental and has a normal distribution with parameters a 


and o. To reduce the errors, the object is weighed n times, and the arith- 
metic mean of the results of n weighings is taken as an approximate va- 
re 


lue of the mass, ie. Y (n) = <x ;. (1) Find the mean value and the 


i=! 
mean square deviation. (2) How many times must the object be weighed 
to reduce the mean square error of the mass ten times? 


Tl 
Solution. (4) M[Y (n)] =— >; M[X;]. Since the object is weighed 


imi 
under the same conditions every time, it follows that M [X,]==a for 
any i, and then 


n 
M [Y (n)| =— > a=— =. 
=1 


Assuming the errors in each weighing to be independent, we find the 
variance of Y (n): 


wh rf) 

4 4 2 2 

Var [Y (72)] = TF 2 Var [X,] =a a G2 = —. 
(2) The number of weighings m can be found from the condition 

olY (n)] = Von = o/Vn = o/10. Hence n = 100 
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7.19. A luminous spot representing a target being tracked on a eir- 
eulat radar screen can accidentally accupy any placa on the screen (the 
nrobability density 1s constant). The diameter of the screen is D. Find 
the mean values of the distance A from the luminous spot to the centre 
of the screen 


Solution. R= V X?24-¥4, where (X, Y) is a system of random var- 
ables uniformly distnbated ia the circle Kp of diameter Dy 


f(z, y= 4) (xD) for (ty) E Rp 
m,=MIRI | | V2 Fy sr aray 





{K pt 
or, passing to polar coordinates (r, ¢} 
, on = DIB 5 
My = 75 { dep \ r? dp =a — 
a OG 


-.240 Hach of two pomts X and Y may independently occupy an 
accidental position on the interval (0, 1) of the abscissa axis (Fig. 7.204), 





i? fa) iz 
Fig. f.2u 


the probability denstty on tha roterval being constant for the twa va 
riables Find the mean value of the distance & between the points and 
the square of the distance between them. 

Solufion. We have R=|Y—X |, m. =M{}Y¥ —X |]. We re 
present the system of random variables (X, ¥Y)} as a random point on 
the x, y-plane (Fig. 7 205) distributed with constant density f (z, y) =! 
ut a square with a side equal to unity. In the domain 0D," X > Y, 
[Fr ~X]=—X —Y.InthedomainD, Y=» X;|¥ —X [= Y—4- 


ro (z— d am 
m }) z— yy) zdy+ (hy 2) dz dy 


! (Ds) 
- i 

= {ds \ (z—~y) dy-- \ dy \ (y—2) dea 
6 6 6G 5 8 


Mj R?} = Ml] Y—X }3] =a, (¥]-+a,[X]—2n,m, 
= 2 (Var, ++ mi)— 2m? = 1/6. 
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7.21. There is a unit square K (Fig. 7.21). Points X and Y fall at 
random and independently of each other on the adjacent sides of the 
square. Each point is uniformly distributed within the limits of the 
respective side. Find the mean value of the square of the distance be- 
tween them. 

Solution. R? = X? + Y*; M[R*] = a, [X] + a, [Y] = 2/8. 

7.22. The conditions of the preceding problem are changed so that 
the points X and Y fall not on the adjacent but on the opposite sides 


/ / 
K 


Fig. 7.21 Fig. 7.22 


of the square (Fig. 7.22). Find the mean value of the square of the dis- 
tance, between X and Y. 

Solution. R? = 1-+ (Y — X); MIR" =1+4+ a, IY] + o, [X] — 
2M (X] M[Y] = 1 + 2/3 — 1/2 = 7/6. 

7.23. The conditions of the preceding problems (7.21 and 7.22) are 
changed so that the points X and Y may accidentally and independently 
of each other occupy, with constant probability density, any positions 
on the perimeter of the square K. Find the mean value of the square of 
the distance between them. 

Solution. Let us choose three hypotheses: 


H, = {the points X and Y fall on the same side of the square}; 
if, = {the points X and Y fall on the adjacent sides of the square}; 
ff, = {the points X and Y fall on the opposite sides of the square}. 


The mean value of the variable R? can be found by the complete 
mathematical expectation formula 


[R?] = P (4,) M[R? | A,) + P (4,.) M[R? | Z,] 
+ P (#,) M [R? | ZI, 
Where M{R? | A,J, M{R? | H,), M [R? | H,] are the conditional expec- 


tations of the variable R? on the corresponding hypotheses. 
From the solutions of Problems 7.20, 7.21 and 7.22 we have 


MIR? | H,] = 1/6, M[R? | A.) = 2/3, M[R? | H,] = 7/6. 
12—0575 
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value equal to the probability of a hit 


41 [X 4} = Py = ZA (LN), 
whence 


Ti 
22 Al at 
fam} 


728 Any contour (convex or nonconvex open or closed) of length | 
13 thrown at random on a plane ruled with parallel straight lines ap 
peartng in the preceding problem Find the mean value of the numba 
of times the contour and the lines intersect 

Solution As in the preceding problem M[¥] = 2i/{£-1) To prov 
this we must divide the contour into n elementary, practically straight 





Tig 7 29 Fig 7 30 


sections of length Ai For each of them the expectation of the number dl 
hits 18 2Af/(£7) and for the whole contour it 15 2E/( Em) 

729 A convex closed contour of length 2? whose Largest dimension 
does not exceed Z 1s thrown at random on a plane ruled with parallel 
straignt lines £ apart (Pig 7 29) Find the probability that at will 
tersect a line 

Solution We designate the required probabihty as p Y being the 
number of pornts of intersection of the contour and a line Since the 
contour 13 Convex and closed and ifs largest dimension 1s smaller th2 
L it may either intersect the lines twice or not at all The ordered 
series of the random variable ¥ is 


o j 2 
<+ koh} n 
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Solution. (a) Let us consider the straight lines which bound the rec- 
tangles to be two systems of lines, horizontal and vertical. We consid- 
er the following events: 


A = {the needle cuts a vertical line}, 
B = {the needle cuts a horizontal line}. 


Since the position of the needle with respect to the vertical lines 
does not affect its position with respect to the horizontal lines, the 
events A and B are disjoint; therefore, the required probability is 


P(A + B) = P(A) + P (B) — P(A)P (). 

On the basis of Buffon’s problem, P (A) = 21/(xZ), P (B) = 2l/(xM™), 

whence 
P(A + B) = 21/(aL) + 2l/(nM) — 42P/(n? LM). 

(b) The random variable X = X, + X., where X, and X, are the num- 
bers of intersections between the needle and a horizontal and a vertical 
line respectively. 

Dividing the needle of an arbitrary length 72 into elementary sec- 
tions, as before, we have 

M[X] = M[X,} + MLX,] = 21/(aL) + 21/(nM). 


7.31. A rectangle of size 1, x J, is thrown on a plane at random 
(Fig. 7.31); all the values of the angle © are equiprobable. Find the 
mean value of the length X of its projection onto the z-axis. 


Al, 
by Lo | 
: 
4ixr 
| |e 1 ly 
| X;1 XP Loy | 
Pe sos a 
o — L 0 a Z 
Fig. 7.31 Fig. 7.32 


Solution. We represent X as a sum X = X¥,+X 
olution, = where X, is the 
projection of the section J, and X., is the molettion of th ti 
The required mean value mre a 


M{X] = M[X,] +M [X.] = 21,/an + 21,/n = 2 (2, + 1,)/x, 


1.e. it is equal to the perimeter of the rectangle divided by =. 
(.32. A convex closed contour of length 2 is thrown at random on 


a plane, all the orientations bein . . 
é g equiprobable (Fig. 7.32). F 
mean value of the length X of its projection na the pee =a 
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We can find the probabilities of the hypotheses, re P(i#)=1/4 
P(H,)= 1/2 and P(H,)=1/4 Hence 
2 


| f f.,2, i 7 
MM [#7] = = Xe XKory X—E=y. 


7.24. Arandom sariable X has a probahilsty density f (7) We con 
sider the function Y = min {X, a}, where a 1s a nonrandom variable 
Find the mean value and vartance of the random variable Y without 
resorting to its distribution 

Solution. By, the general formula (7 0 7%) 


MU y= \ min fz, al f(zjdz 
For r<ia, we get minf{z, a}=2 for xtea, we get min{z, e}=a 
Hence 
iI 


Miy1= | af(zdste | f(eydem | af (z)dz+aP(X>4} 


— fo 


(7 24 f) 
By analogy we find the second moment about the origin 
‘ {c0 a 
tof) = \ z"} (2) dx+ a \ fiajdz= { aif (2) dz -+-atP {X > a} 
~ ” (7.24 9) 


and the varrance 
Var {Y) = a, 13) — MLYIy 
7.25 The same question as in the preceding problem, but ¥ 1s a dis 


crete random vartable assuming positive integral values with the pro 
babilities defined by the ordered series 


tA) jet jr 
Pr | op, L pa | | Pn 


a 1s a nonrandom positive integer included between 1 andn (Il <a<— n) 


, Y=min{X, ¢}, 





Solution M[Yt= > minfk, a}p,, for k<la, we get min{h, aj= 
A=] 
k, for ADza, we get minff aj=e@ Then 


aif +1 


M|¥]= > Pata D Ps 


Rol 
By analogy, we find the second moment about the origin 


a-l fi 
ms (V}= 2) Mp, ta® Do Pa 
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and the variance 
Var [Y] = «, [(Y] — (MIY])*. 


7.26. A number of independent trials are carried out in each of which 
an event A may occur with probability p. The trials are terminated as 
soon as the event A occurs and the total number of trials must not 
exceed VV. Find the mean value and variance of the number Y of trials 
that will be made. 

Solution. We first consider a random variable X which is the number 
of trials if the restriction N concerning the total number of trials is 
removed. The random variable X has a geometric distribution begin- 
ning with unity and its ordered series is 


x: p | pq | s+. | pgk-t |... (q= 4 P). 


The random variable Y is the minimum of X and V: Y = min {X, N}. 
On the basis of the results of Problem 7.25 we have (setting 7 = oo) 


N-{ CO N-i co 
M[Y]= 2 kpxtN 2 py = 2) kpght+N Dd pgh' 
k=1 k=N k=1 h=-N 


N-1 00 
=p{ dy kgkt-+N D qe}. 
k=1 k=N 


We calculate the first sum 





N-i N-1i 
DY kgt= > ty geen cae g—qh __ 1—Ng¥~*-+(W—1) g™ 
coe = dq dg 1—g (4 — gq)? : 


The second sum is equal to (NqN~1)/(1 — q), whence 


4——NgN-! = N N-i_ na, N __ AN 
M[Y]=p q +(N qo Nq _ 1 - 


7.27. In Chapter 1 we considered Buffon’s needle problem: a needle 
of length Lis thrown at random on a plane which is ruled with parallel 
Straight lines L > 1 apart. The probability of the needle hitting one of 
the lines is p = 21/(Lx). Since for! < LZ the number of hits can 
only be 0 or 1, the mean value of the number of hits is p. What will 
be the mean value of hits if the restriction 1 << L is removed? 

Solution. We divide the length J of the needle into nm elementary 
sections Al = l/n < L. The random variable X is the number of times 





Th 
the needle hits the lines. It can be represented as a sum X = bie i 


: , . » « keg 
_ X; is the number of intersections of the needle and the lines of 


i ith elementary section. The random variable X; is the indicator of 


1€ intersection of the ith section and one of the lines and has a mean 
{De 


F 
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Solution. Since the contour 15 convex, cach element Az of the projec- 
tion results from the projection of tuo and only two opposite elements 
of the contour Ad, and Al, (see Fig 7 32}, hence the average length 
of the contour projection ts half the sum of the average lengths of the 
projections of the elementary sections AZ into which the contour can 
be divided 





¥, 
M[X] = 3 > a 


rit T 
733. There is a random variable X with probability density f (x) 
Find the mean value and variance of the random variable F = |X { 
Solution The notation Y = |} A | means that 
—X for X <0 
— { A for X>O 


fT me 
my =Mi¥ (= { (el f(z)de=— | xf (x)dx \ af (x)dz 
a aww 0 
= \ rif(z)-+f(—2) dz, 


0 


Vary =a,[¥]—my= | | x]? f(x) dt—mj 
=a, [X]—mi = Var, +m? —my 
734 Find the mean value and variance of the modulus of the random 


variable A, which 1s normally distributed with parameters m, 0 
Solution. ft follows fram the preceding problem that 


, “ _tt-m iz —mp 
in,, = ——_-—_~ | ze om? de + —.——___ | ze 2a dfx 
Y a V 2n e T oy2r + 


Changing the variables (x — m)/a = i, we got 
Tr 


2 oe, 


o tt ea 
me et — 4 “2 dt 
iy Vir J (fo-+--mje 2 di+ | {ia + ime 
a 





VY’ 21 


— 29 oats) cp im 
ag +-mo (3), 


where ( is the error function 





Var, —: tf" + nm my 
In particular, for m = 0, 


“- 
my = V 2ox 0 800, Var, =o? ~ ota ( 4 — a? 2 0 360? 
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7.35*. Independent random variables X and Y have probability 


densities f, (x) and f, (y). Find the mean value and variance of the 
modulus of their difference Z = | X — Y |. 
Solution. We have 


y 
mn, = (| |co—y | fy (x) f, (y) dx dy. \\ 


yy-2 


A straight line y = x divides the zx, y-plane 


into two domains I and II (Fig. 7.35). SAAwq z 
In domain I zr>y, |x—y|l=axr—y. LZZZ- 


In domain II y>a2, |x—yl=y—z. 


Hence Fig. 7.35 
m, = (t—y) fs (2) fe (y) da dy + \ | (y — 2) fy (&) fy (y) da dy 
(1) (11) 
= \ fy (x) dz} dy 


xf, (2) { fo (y) dy dx — ( wwf 


+f mw) nerar}ay— J ate 


—& 


fe. (y) dy} dx. 


We introduce the distribution functions 


x 


y 
Fy(z)= J f(ede, Fiy)= | fe(yay. 


— OO 


Then we have 


m,= \ af, (2) Fe(z)de— | yf (y) U—Fi(y)] dy 


oc oo 


+S ufs() Fily)du— § af, (2) [1 —F, (2) de. 


Combining the first integral with the fourth and the second with the 
third, we obtain 


co 


m, = \ [2rf, (x) Fy (x) — xf, (x)| dx+ \ [2yfe (Y) Fs (¥) —yfe (y)] dy 
=2 \ xf: (2) Fy (z)dz—m,+2 | yfs(y) Fy (uy) dy—my. 


= OO 
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Solution Stnce the contaur ts convert, cach element Ar of the prope 
tron results from the projection of tuo and only two opposite elements 
of the contour Al, and Al, (see Fig 7 32), hence the average length 
of the contour projection is half the sum of the average lengths of the 
projections of the elementar} sections Af into which the contour can 
be divided 

M[X]=> zat tT 
K 

7.d0. There is a random variable A with probability density J 

Find the mean value and variance of the random variable Y = |X [ 


Solution. The notation Y = | X | means that 
—AX for X <0 
~ { for XN >O 


+ ag i enn 
m,=M|Y | \ jz ( f(z}dz=— | xf (z)dz | xf(a\dz 
0 


= oe. mr Oi 


c= | 2[f(z)+f(~2)dz 
o 
Var, =a,/¥}—my= \ [x]? f(x) dx—mi 


= a, {X}— mj = Var. -+ mi — mj 


734 Find the mean \alue and yarrance of the modulus of the random 
vaniable X, which 1s normally distributed with parameters m, 5 
Solution It follows from the preceding problem that 


Changing the variables (rx — m}/o = t, we get 


ae? eee 


Fr 


= | (ta-+mje 2 dl 
+ 


My —~ j§ (t6--m)e" 2 











i,m. 
2c -+(F) it 
—————-e Fila mp (=) , 
} 24 + G 
where @ is the error function. 
Var, = g? + mt — my 
In particular, for m = 0, 


2 
My = V tox 0 80c, Var, =0?~—=-ot= (1 —+) o? = 0 36a? 
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+-vp [0.5—@ ("2 ) | = 1-6, | to (P(t) +0.5) 


Opn 


Vo— My 
Oy 





? 


1 exp [-]] , Where t= 
a, [Z| = vf (v) dv + | v3F @) dv = (m2. -+-o2) (D (é,) + 0.9) 


ee v0 


+ Vp [0.5 — P (t9)] — 


oe 


20 yMy + O02 to #2 
——— CEN 9 


0 
V an 
Var, = 049 [Z] —m? = 03 { (1 +- £4) (P (fo) +0.5) 





4 te exp | —“2-|—[ t) (® (¢q) +0-5) 


+ "a7 exp | -2\1} , 


Note that if vy==m, and t,=0, then m,=m,—o,(Y 2x)", 
Var, == 0; (%— 1) (22). 

7.38. N messages are being sent over a communication channel. 
The lengths of the messages are accidental, have the same mean value m 
and variance Var, and are independent. Find the mean value and vari- 
ance of the total time Z during which all V messages will be trans- 
mitted. Find 7,,,,, which is the maximum practically possible time 
during which the messages can be transmitted. 





nr 
Solution. T = > Tis where 7; is the duration of the ith message 
ix 
(i = 1,2, ..., N). By the addition theorem for expectations we have 
N 


N 
M[7]=M [2 7, |= >) M(7)=Nm. 


i=! 
By the addition theorem for variances, we have 


IN N 
Var [7] = Var | 2 7, = >) Var [T;]=N Var, 
i=] =i 


o,= V Var [7] = VN Var. 


By the three-sigma rule Tnax = Vm +3) NVar. 
(.39. Solve the preceding problem for the case when the lengths 7; 


of the messages are dependent and the correlation coefficient of the 


random variables 7; and T; is li j- 


Solution. The mean value is M [7] = Nm as before. To calculate 
the variance, we find the covariance of the variables T ; and T;: Cov;; = 


» ito 
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Since Y and ¥ are independent, it follows that 
a, {Z}=M[|X—Y PJ =M[(x— YY} } = M [X27 4M [Y2]— 2M EX] MIF] 
=, [X} 4-0, [Y}—2m,m, = Var, -+ Var, + (mt, — my)? 


From this we find that Var, = a, 12)— 7m? 

7,06. Two independent random variables X and Y have probability 
densities f, (z) and f, (y} Find the mean value and variance of the 
minimum value of two variables, ie Z = min {X, Y 

Solution, 

Z= (+ . i AY, 
Y, wWX>Y 


A straight line y = 1 divides the z, y plane into two domarns (see Fig 
735) I, where Z = Y, and JI, where Z = X (the case X = Y 1s not 
considered since it has a zero probability). 


m,=M [Z|= | \ zf,(2) fa(ydzdyt | | yf. (2) fry) dzdy 
{11} 


(Ly 
== \ ef(2y{i—F,(2de+ \ yf, (yt — Fry) dy. 


where F, and F, are the distribution functions of the random variables 
A and ¥ 


sa 


co 
a (Z)= \ Ph (2 Fy (@)ldz+ | vf. (y) L—Fily) dy 
Var, =a, [Z| — im? 

7.37 A random voltage V has a normal distribution f {v) with pa- 
rameters m, and o, The voltage V arrives at a limiter which leaves 
equal to Vif V <u, and makes it equal to vy of V > vy 


VY for V Sv) 
t's, for V — Vas 


Find the mean value and variance of the random variable Z, which 15 
the voltage taken off by the limiter 


Solution Proceeding fram Problem 7 24 we have 


Z=min{V, n={ 


m= M{Zt= { min {p, vo} f (v} dy == \ vf (vy dv + { va} (v} du 


= a0 — oy TH 


f (v) dv 


bt 
\ Vea exp [ ee | dv+v, 


~me [0 (5 )4-05)~ piper —$ (SEE) 


_— 
a. 


"38 
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+9 [0.5—@ (-2="2-) | =vp—a, | to ( (40) +.0.5) 





{ be _ VoTMy 
aa exp | --+]] , Where | a hie 
a, [Z] = \ v2f (v) dv + \ vii (v) dv =(m2-+02) (® (t,) +0.5) 
— 90 U0 


20 yy et 2 
+ Uo (0.5 —@ (t)] -— exp | | 


V on ~ a 
Var, = |Z] — m3 = 03 { (1 +- £4) (® (to) +0.5) 


to 


+ = exp| —-3-]—| to (@ (4) +0.5) 





yhoo [-$ 


Note that if vy=m, and t,=0, then m,=m,—o, (V 2n)7, 
Var, = 0; (a — 1) (2n)1. 

7.38. N messages are being sent over a communication channel. 
The lengths of the messages are accidental, have the same mean value m 
and variance Var, and are independent. Find the mean value and vari- 
ance of the total time 7 during which all NV messages will be trans- 
mitted. Find 7.,,, Which is the maximum practically possible time 
during which the messages can be transmitted. 

tt? 
Solution. 7 = ila, where 7’; is the duration of the ith message 
i=1 
(i= 1,2,..., N). By the addition theorem for expectations we have 
NN 


N 
M(7]=M[>) 7, |= > M(T)=Nm. 
i=1 


i= 
By the addition theorem for variances, we have 


N 


IN 
Var [7] = Var| >) 7; |= >) Var {7;]=N Var, 
i=] i= | 
O,= V Var [7] = VN Var. 


By the three-sigma rule Tmax = Vm +3) NWVar. 

(.39. Solve the preceding problem for the case when the lengths 7; 
of the messages are dependent and the correlation coefficient of the 
random variables 7; and 7; is rj;- 

Solution. The mean value is M [7] = Nm as before. To calculate 


the variance, we find the covariance of the variables 7 ;and 7';: Cov;; = 
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r,,07 = ry, Var By formula (7 0 28) for the variance of the sum 
Yar [7] = ji Var -}- 2 2 rey Var = Var (V+2) rit} 
d = 
Tmax =Am+3Y Vari] 


740 A system of random sartables (A, ¥) 18 untformly distributed 
ma rectangle R (Fig 740} Find (1) MIX 4 Yt (2) MIX —11 





Tig 7 40 


(3) MIX}] (4) Var[A +14] (5) Var[X —Y] (6) Mi(xX — YY! 
and {7} M{2¥% 4 3Y° + 1] 

Answer (1) 3/2 (2) 1/2, (3) 1/2 (4) 5/412, (5) 3/12, (6) 2/3 and (7) 6 

¢ 41 Random faultS occur when an electronic device is operating 
The average number of faults occurring per unit operation time 15 4 
and the number of faults occurring during the Operation time T of the 
device is a randam variable having a Poisson distribution with para 
metera = At Toclesf a fault (to repair the device) a random time Tyep 
isrequired which has an exponential distribution f {#) = we #t for? > 
The times required to clear separate faults are independent Find (1) 
the average fraction of time during which the device will operate fault 
free and the average fraction of time the repaira will last and (2) the 
average time interval between tuo faults 

Solution (45 The average time of fault free performance of the dese 


{the mean value of the time from the moment the device is put into 
operation until the moment it 1s stopped for repairs) toound = 1/ The 
average time needed Ior repairs t.., == t/p The average fraction of 
time during which the device will operate fault free 


ee eso A 
fsound-Ftrep 1/A- 1/4 A+ wa 


Similarly the average fraction of time during which the device wilt 
be repaired 


=f—« = AA + ph 
(2} The average interval of time I, between tuo successive faults 
Fy = teouna + trep = 1A + the = (A + ya) 


742 A randam paint (X YY) has a normal distributian on a plane 
With circular scattering 1e mm, = m, = 0 and o, = ,=6 A rant 
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dom variable R is the distance from the point (X, Y) to the centre of 
scattering. Find the mean value and variance of the variable AR. 


Solution. 








R=VXRX*4+Y2. 
=MiR)= {| Vxet+y? 535 exp (- PEL | dx dy 


Using polar coordinates 7 and qg, we get 


21 


m= {2 saexp ( — sx) dr | dgp=o / 4 w 1.250. 
0 





as = 4 
Var, = Var[R] =a, [R]—m? = | { (22+. y*) sa exp (—SE*) de 





20-51 


00 2 

: 4 r? at 
iy —mt= | rh exp (—se) ar [ayo 2 

G 0 


__ 9 —t = oe: 2 4-1 
— Io \ te dt—o 5 0) 5 
0 


1.43, Prove that if a random variable X has a binomial distribution 
with parameters nm and p, then its mean value M [X] = np, and its 


variance Var [X] = npq (q = 1 — p). 
Solution. X is the number of occurrences of an event a in 7m inde- 


pendent trials. It can be represented in the form X= > X;, where 


A; is the indicator of the event A in the ith trial, i. e. 


XY, — { if the event occurs on the ith trial; 
‘10 if the event does not occur on the ith trial, 


M[X;]== p, Var[X;] = pq, 


pq =npq. 


iN 


M[X]= > Mixd=np. Var [X] = 


7.44. Prove that for n independent trials, in which an event A occurs 
With probabilities p,, po, ...+; Pn, the mean value and variance of 


the number X of occurrences of the event are 


71 Tt 
M(X] = px Pi3 Var[X]= 2: Pi9i, Where gj =1— p;. 
i= = 
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Solution. By analogy with the preceding problem X= 23 xi 


where X, 15 the indicator of the event A in the tth trial 


TI Lr Ti TL 
MiX] = py M[X,] == 2 Py, Var (X}= % Var [Xj] pa Bide 
= a = _ 


7 45. We consider nm independent trials in each of which an event A 
may occur with probability p Find the mean value and variance of the 
frequency } of the event A Find the range of practically possible values 
oi the frequency 

Solution. YF = X/n where X 1s the number of occurrences of the 
event A 


M[¥J=M[X]/n=—np=p, Var[¥}=npq/n?= pain, 


Y= V Var | Y | =Y pg/n, 
where g=-1—p The range of practically possible values of Y 
m+ 3 Oy = p + 3V pain 
746. Prove that the mean value and variance of a random variable \, 


which has a hypergeometric distribution (see 4 0 34} with parameters 4, 
bm are 


M[XJ=—>, Var[X] =" 


tne ilste tee ate)] a 





respectively 

Solution Let us consider a physical model of a situation im which 
a hypergeometric distribution occurs, say drawmg 7 balls from an 
urn which contains a white and & black balls, X 1s the number of the 
white selected balls We can represent n selections of a ball as 7 trials 
in each of which an event A = {a white ball} may occur We represent 
the variable X as the sum of the variables A, which are the indicators 


of the event A in the ith trial, X = DP: ¢ The random variables 4: 


i=t 
are mutually dependent, but the addition theorem for expectations 3 
applicable +12 


MIX] ~ D MIM, MIXd=spp 
f=! 


M[X]= 7 
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The variance of the sum of the random variables X; can be found from 
formula (7.0.28): 


Var Px X,|= py Var (Xj]-+2 2 Cov, (7.46.2) 


; a 6 6s a 
VarlAd= P= 45 Go G+OF’ 


Tt 


nab 
> Var [Ad]=GaH 
jz=1 
Let us find Cova) = M[X;X;] —M [X;] M[X,]. The product of 


the indicators X;X, of the event A in the ith and the jth trial is equal 
to unity when X; = f and X; = 1, i.e. the event A occurs both on the 





ith and on the jth trial, the probability being equal to aes x 
wo the expectation is equal to the same value. Hence 
MIXX] =p 
Hence 
Corse epee (eee) (746.8) 


The number of terms in the sum > Covazxy iS CR = n(n — 1)/2. Sub- 


i<j 
stituting (7.46.3) into (7.46.2), we get formula (7.46.1). 

7.47. There are five white and seven black balls in an urn. Six balls 
are drawn at a time. A random variable X is the number of black balls 
drawn. Find the mean value and variance of the variable X. 

Answer. M [X] = 3.5 and Var [X] = 35/44 ~ 0.795. 

7.48. A radar installation scans a region of space where there are V 
targets. During one surveillance cycle the ith target may be located with 
probability p; (i = 1, ..., N) independently of the other targets. 
During a period n cycles are realized. Find the mean value and variance 
of the number of targets X which will be located. 

N 


Solution. X = 5\X;, where X; is the indicator of an event A, = 
i=! 
{the ith target is located}. 


P(A;)=1—(1—p;)", 


N N 
MIX}= 1 —-(1—p)I=N— YB py, 

ee I=={ 

. 


Var (X)= 3) (4—(1— pi" (1— pa 


49) Appled Problema in Prodability Theory 


As the number of cycles ny tends to infmty 
hm M{X]=N and lm Var[X}=0 


i oo fl oc 

2e in the Immuit as m— co all the targets will be located 

7 49* We take an arbitrary point A inside a circle of radius a (Fig 
749) and draw a chord BC through it at an arbitrary angle © to the 
radius which passes through the point A Find the mean length of the 
chord 

Solution We take the point A at random inside the circle and there 
fore its polar coordinates # and @ are independent and have distribu 
tions 


A()=fr for O<r<a, fylg)=—e for 0<g<2a 


Since the mean value of the chord 1s evidently independent of the an 
gle wetahe the point A on an arbitrary radius (at a distance # fram 





Fig 749 Fig 750 


the centre) and draw the chord BC through it at a random angle 0 
to the radius It follows from the hypothesis that the random variable 6 
has a probability density f, (G) = 1/25 for O<CO<< 2n We express 
the length D of the chord AC in terms of the random vanables A and © 
by drawing a perpendicular from the centre of the cirele to the chord 
and designate its length as #7 It 1s evident that 


D=2Y 2—H?, H=RsinO 
D=2)/ a? ~ BR s1n26 


The mean value of the random variable ) can be found as 
i | a 





M iD] = | ao | 2Var— rants Je a dr 
z 
_ 8 ‘| a7 (4 cos? $5 de 1G me 1 TO 
~ a3 : 3a n?¢ ~ 3x ™ 


7 50* Find the mean value of the lencth of the chord BC (Fig 7 of) 
drawn through a point 4A inside the circle which is at the distance 
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from the centre of the circle of radius r, all the directions of the chord 
being equiprobable. 

Solution. The chord BC can be expressed in terms of the quantities L, 
@ and r as follows: 


BC =r Vf 1—p sin? ®, 


If we consider the length of the chord BC to be a random variable X, 
then , 


/2 ee ee zt/2 
Mn, = \ = 9, V1 —~ (—)"sin?p dp == \ V1i— sin? pd, 
0 0 


where k = L/r. The integral obtained is a complete elliptic integral 
E (k, 1/2) with modulus k; its values can be found in handbooks. For 
instance, fork = 1/2 the integral E (41/2, 1/2) = 1.4675 andm, ~ 4.87r. 

Since the complete elliptic integral E (k, n/2) is measured from 
w/2 (for k = 0) to 1 (for k = 1), the mean length of the chord assumes 
the values from 2r (for k = 0, i.e. for the point A at the centre of the 
circle) to 4r/n (for L = r, i.e. for points A on the circle). 

7.51%. A device consists of m units, each of which may fail indepen- 
dently of the others. The time of the failure-free operation of the ith 
unit has an exponential distribution with parameter A: 


fi (2) = MenMt (t > 0). 


A unit that fails is immediately replaced by a new one and is repaired. 
The repairs of the ith unit last a random time distributed according to 
the exponential law with parameter p,: g; (t) = u,e#,t (ft >> 0). The 
device operates for a time T. 

Find (1) the mean value and variance of the number of units which 
Will be replaced, and (2) the mean value of the total time 7 which will 
be taken by the repairs of the units that failed. 

Solution. (1) We designate as X; the number of units of the ith type 
that fail during the time t. This random variable has a Poisson dis- 
tribution. Its mean value mx, = 4;t and variance Var... = 4,;t. We des- 


ignate as X the total number of units that failed during the time t. 
We have 


nT 


n n 
X= > Xis MN». = 2 ie = © > i. 
: a ix==1 


I= 


i 


The variables X; being mutually independent, we have 
7 ut 
Var,= >) Vary, =T a 
i=} 


(2) We designate as 7; the total time needed to repair all the units 
6. type i that failed during the time t. It is the sum of the times needed 
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to repair all the units Since the number of units is X;, we have 
x 
‘ié =P +T? + err S ry, 
=! 


where 7? 1s a random vartable which has an exponential distribution 
with parameter 4, and the quantities 7Z'{", FY’, are disjoint 

Let us find the mean value of the random variable T, wsing the in 
tegral formula for the complete expectation We assume that the random 
variable X, assumes 2 definite value m and then the mean value of the 
variable 7’; 


MIT, mp= SD MITMy = F Lae 
A= 


Hi hE 
k= i 


We multiply this conditional expectation by the probabrlity Pp 
that the random variable X; assumes the value m sum the preducts 
and find the complete (abselute) expectation of the variable 7, 


A 


T 
Fly 





MIT = Sy Pe YS) mPp a MIX = 
man} 


Tila] 


Using then the theorem for the addition of expectations we obtain 


MIT] = 5) = 


i=1 


Note that the same result can be obtained by a less strict argument 
The average number of failures of the units of the ith type during the 
time Tis Ait the average time taken to repair one unit of that type Js 
ij; and the average trme which will be spent to repair all the uals 
of type i that fail during the time ¢ 1s A:t/u, The average time that 


TL 
will be spent to repair all the units of all types 1s 1 py at 
f 

i-1 


¢52* The conditions of Problem 752 are changed so that each 
unit that fails 1s sent to a repairshop and the device 1s stopped for the 
time needed for the repair When the device does not operate other 
units cannot fail Find (1) the mean value of the number of stops of the 
dexwee duning the tuma st (2) the waon valoe of the pant of the time 7 
vane the device wilt be idle {it 1s also the mean time spent on 
repairs 
Solution (1} We designate the number of stops during the time T 
as X and find rts mean value m, We shall use the followimg not very 
strict (but true) arguments to solve the preblem ‘We represent the 
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operating process of the device, infinite in time, as a sequence of “cycles” 
(Fig. 7.52), each of which consists of a period of operation of the system 
(marked by a thick line) and a period of repair. The duration of each 
cycle is the sum of two random variables: Toye, (the duration of oper- 
ation of the device) and 7 yep (the time taken to repair it). The average 


ee ne ee 


0 SS eye OO eee i 
1st cycle 2nd cycle Irdcycle 4th cycle 


Fig. 7.52 


duration of the operation of the device Ms | can be calculated as the 
mean time between two consecutive failures in the flow of failures of 


intensity A= iA; it is 


i=l 
7 
Moyer = a= Ap DY de 


We seek the mean time of repairs Mt en" We find it using the complete 


expectation formula on the hypotheses H; ={a unit of type i is being 
repaired} (i = 1, 2, ..., 7). 


The probability of each hypothesis is proportional to the parameter 


VEes 


Pp (H;) =h,/ be hs =A,;/h. 
i={ 


The conditional expectation of the time taken by the repair on this 
hypothesis is 1/u;; hence 





n nr 
m — S' di; — 4 > di 
'rep 2! Ru; OA Luz ° 
i= i=l 


The average time of a cycle 


Tt 


Th 
_ 4 { 7 Nj ee i ; hj 
m= pty DHT (t+ +). 





Bj 


Let us now 


she represent the sequence of stops of the device as a sequence 


andom points on the t-axis partitioned by intervals equal to m, _. 
e 


The average number of stops during the time t is equal to the average 
Humber of random points on the interval + long; 


Tt 
nee dj 
My = THM = At] ( { +. > 1) : 
i 
i= 
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(2) During each cycle the device will be idle (will be repaired) 


ri 


tad 
for time m; => 2) <r on the average; consequently, the average 
f= 
idle time 
Ft 7 
AF 1 Ag _ Ag hi 
Ps trey = ar qo) Tt (f+ 2) By 


ixi 


7.03. A Tandom variable X 1s normally distributed with characterp 
tics m, and a, The random variables Y and Z are related to A, as 
Y = X* and Z = X5 Find the covariances Cov,,, Cov, and Cory, 

Solution To simplify the calculations we pass to the standardized 
variables and use the fact that for a standardized norma) variable 


X = A— mm, all the central moments of odd orders are equal to zero 
and M[X?] — a} M [X*] = Sot (see Prablem 5 26) Since 

¥ =(X +m,)?-—M (X2] = X24 2¥m,-+-m2— Var,—m 

= X2 +2Xm,—03, 

it follows that 

Cova, = M (XY = (X (X2 +- Xm. —o2)) = 205m, 
Furthermore 

Z=(X +m,)§ —M [X43] = X44 3X2. 4+ 3Xm2-+ m3 —(3m,02 +) 
== X9-4.3X2m,-+ 3Xm2— 3m.02 
and therefore 
Covy,= M [XZ] = M EX + gm MM [X2}-+ 3m? M [X?] 
— 3m,02M (X] == 30% + Smock 
and finally 
Cov,,=M (X24. 2Xm,—02) (x3 + 3X2m,. + 3Xmi— 3m,02)1 
= 5m,M [X4) +- 6m, (m2 — 02) M [X2} + Sin ot = 12m01 + 6mia3 


7.54 «An object whose mass is a g 18 welghed four times using an 
analytical balance, the results obtained are X,, Xq, Ng, Xq Their 
arithmetic mean is taken as the measured value of the mass Y= 
(Xy -+ X,-+- X_, + X,j/4 The results of tho weighings are mutually 
independent The balance gives a systematic error m, = +0001 g 
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The mean square deviation of each weighing o, = 0.002 g. Find the 
mean value and the mean square deviation of the random variable Y. 

Answer: m, = a + 0.001 g; oy = o;/2 = 0.001 g. 

7.55. Four independent measurements are made of the same vari- 
able X. Each measurement is characterized by the same expectation 
m. and the same mean square deviation o,. The results of the measure- 
ments are X,, Xo, X3, X4. We consider the differences between the 
consecutive measurements: Y, = X,— X,, Yye=X3—Xq, Y3= 
X,— Xj. Find the mean values m,,, my, and m,,, the mean square 
deviations 0,,, Oy,, Oy, and the standardized correlation matrix || 7;; |}. 

Solution. 


it, gy Sys 0; Oy, 0), = G7, = 20, 
6. = 0 0, = 02 2. 
Since the variables ee Xx, em x, are mutually independent, 
Cov ye = M[(X_p— 4) (X3— ¥0)] == ~M[X2] = —oi, 
Covey, = M [(X_— Xe) (X,—X5)] = —M [X2] = — oh, 
Covyiyg = M [(X.— X41) (X,— X5)} =0, 


ryiy.= Myoys = “202 == nay ) Tyvye a Q, 
4 —1/2 0 
rez = t — 1/2 
1 


7.96. A hole may occur with equal probability in one of the six walls 
and at any point on each wall of a cubical tank full of fuel. All the 
fuel above the hole leaks out of the tank. When sound, the tank is kept 
3/4 full. Find the average amount of fuel which will remain in the 
tank after a hole appears. 

_ Solution. We shall assume for simplicity that an edge of the tank 
is equal to unity. We designate the height of the wall as X and the 


—— of the remaining fuel as Y. Since the base area is equal to unity, 
we have 


y= x for XX < 0.75, 
a {0.75 for O75< X¥ <i, 


li the hole occurs higher than 0.75 of the way from the, bottom of the 
a (x > 0.75), then no fuel will leak out and the same amount of 
uel, Y = 0.75, will remain in the tank. The probability of the latter 


case Is equal to the fraction of the surface area of the tank which j 
above the 0.75 level: _ 


P{Y = 0.75} = P{X > 0.75} = 1/6 + (4/6) x 0.25 = 1/3, 
13s 
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If a hole appears in the bottom of the tank (X — 0), then all the 
fuel will run out, and the prebabiltty of thts is equal to the fraction of 
the hottom area of the tank 


P{Y = 0} = P{X¥ =0) =14 


If a hole appears tn one of the walls of the tank X << 0 75 distant 
from the bottom then the amount Y = X of fuel wall remain 1n the 
tank The probability density im the interval (0, 0 75) is constant end 
equal to (1 — 1/3 — 14/6)/0 75 = 2/3 The average amount of fuel 
remaining in the tank 

075 


m=O 75x —4+OXG+ | 2 Fdr=044 
G 


7.07. A point @ 18 fixed in the interval (0 1) (Fig 757) A random 
point X is uniformly distributed in that interval Find the coeffic:ent 


xX 
ay, na ye f i 


R 
big 757 


of correlation between the random variable ¥ and the distance # from 
the point a to X (the distance 7 1s always assumed to be pasitisé} 
Find the value of @ for which the vamables X and #& are uncorrelated 
Solution We find Cov_, from the formula Cov,, = M [AA] — git 
‘ i 
M[XRJ=M(X|a—X |] = \ z ja—a|f(r\jdz— \ xila—xz|dz 
0 
a { . , | 
= | e(a—2) dr— \a(e—s\de= SF ty may, 
0 
| 
Fr 


nl 


rr, i 
. 1 
p= Ja—z|de= | (a—z)d2— \ (a—z)de=a?—a+— 
i o 
Hence 
ae it 1 | a 1 at ik i 
CO —Sogtsgy(@-etyq)=7-Tte 
We find 
1 1 
Vaty= Fy. Ox Oa” Var, = a, [ft] — m,, 


| 
a, |] = \ (a—z}* dx= a2—a-} a $ 
0 


Var, = 203 ata? + , oO; >= V Var,, 
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Hence | 
_{# a, i V an eae — 
rr =(S—Ft39)/ ( eimai Ss 1 


The equation a3/3 — a2/2 + 1/12 = 0 has only one root in the 
interval (0, 1), viz. a = 1/2. Therefore, the random variables X and 
R will be uncorrelated only for a = 1/2. 

7.58. A car can travel along a highway with an arbitrary speed v 
(0<v< vx). The higher the speed of the car, the higher the prob- 
ability that it will be stopped by an inspector. Each time it is detained 
for an average time ty. Inspectors are stationed at random along the route, 
The random number of traffic cops per unit length along the route has 
a Poisson distribution with parameter 4. There is a linear relationship 
between the probability of being stopped and the speed of the car: 
p (v) = kv (0 vu < Vmax), Where k = 1/uy,x- Find a rational speed 
for the car v, at which it will cover the whole route s in a minimum time 
on the average. 

Solution. The average time of covering the distance sis 


= s/v + Asp (v) fp = sip + Askut,. ba | 


_ Tf the minimum of this function lies in the interval (0, Upax), then 
it can be found from the equation 


whence 
UU RTS V 1/(AKto) V Vmax! (Ato). 
This formula is valid for v,< Umax; i.e. for Umas >> 1/(Aty). 


Thus, for instance, for Vm a,=100km/h, A=1/20km~-! and t) = 
20 min 


V, = / 100/ (<5 x=] oy 77.5 km/h. . 


If Unas < 1/(At,), then the minimum of the function t = s/v - 
Asp (v) ty lies outside of the interval (0, vax), and the speed v, = 
Umax IS the most advantageous. For example, if for the data given above 
the time the car is delayed by a cop decreases to 40 min, then v, = 
max = 100 km/h. 

(.09. A number of independent trials are made in each of which an 
event A may occur with probability p. The trials continue until the 
event A occurs-/ times, and then they are terminated. A random vari- 
able X is the number of trials which must be made. Find its mean 
value, variance and mean square deviation. 

Solution. We represent the random variable XY as a sum 


h 
” ? 
XNSX,+X,+...+X, =); Xi, 


os 
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where X, 18 the number of trials made till the first occurrence of the 
event A, X, 15 the number of trials made from the first to the second 
occurrence of tha event A, , ©} 18 the number of trials from the 
(i — {)th to the Ath occurrence of the event A 

Each random variable X, has a geometri¢ distribution beginning 
with umty [see (40 32)], and its charactertsties 


MEA;] = tép, Var (Xl = ofp? q=t—p) 


Using the theorems for the addition of etpectations and variances, 
we obtain 


A A 
M [X} = bz M[X,)=kp, Var[X]= pay Var [X3) = Aqip’, 
= i— 


a, = | Var [X] = V kg/p. 


760 To assemble a reliable device, 4 high quality homogeneous 
parts ara needed Each part 1s subjected to various tests and (independ 
ently of the other parts} may be found to be of high quality with peab 
ability p When 4 high quality parts are selected, the tests are ter 
minated The supply of parts ts practically unlimited Find the mean 
value m, and variance Var, of the randem variable X (the number of 

parts that have been tested) Find the max- 
r imum practically possible number of parts 
| < yx, x, Which will need to be tested, Xmax 
Mi I fe Answer From the solution of the pre 
, ceding problem we have 


Ky>Xzg _ 
' KISS ry m, = kp, Var, = kaip*, oy = V kaip anit 





aX 


RK = 
WA A mar = kp +3 7 kal p. 
\N 7 61 According to a network of manage- 


ment planning the moment Y an operation 
begins 1s the maximum time two support 
ing operations X, and X, are finished ‘Lhe 
random variables X, and X, are mutually 
sndependent and hase probability densities jf, (,) and f, (z2) Find 
the mean value and varrancte of the random variable Y, as well as the 
range of its practicall, possible values 
Solution 


Fig 7 6] 


Ay for Ayo Ags 
No for Ay Kae 


The domain I, where ¥, > 4,, and the domamm II, where X,< Ay, 
are shown in Fig 7 61 


Ya=mar{X, X}=— 


a) Ky 


my = MY )== | ais tea { } fabaa) ean} dey 


= oe om KT 
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xg 


+ { Leafy (Zp) { \ Fy (%4) da, dk, 


= | wah, (a) Fe (a) day t | ahs (2) Fs (wa) dy 


where F, (x) and F, (x) are the distribution functions of the random 
variables X, and X, respectively. 


M{Y%]= | aif, (x) Fo (a) day + \ af (we) Fs (we) dry 


Var[Y]=M[Y?]—mj, 0,= V Var [Y}. 


The range of the practically possible values of Y is my + 3oy. 

7.62, Under the conditions of the preceding problem, the nm support- 
ing operations must be finished before the planned operation is begun 
(moment Y). The moments X,, Xo, . X,», When they are finished are 
mane independent and have probability densities 7, (2), fe (a)s 

, In (Zn). Answer the same questions. 

‘Solution. 


Y=max {X,, X,, ..., Xn} =X; for X;>X; (t= 1,2, ..., n, i<j), 
00 x1 sm | 
m,=M[Y)= \ Lah (2) { (n -~ 1) \ fa (£2) fz (23) 


— CO 


SG Nn) Ot wOd sce dn} dx, 


+) aefy (a) ft | 1 i fs (x4) fy (2s) 


sah ee an Bare in,} AX» 
nr 1 


ee \ Galatta) ){ \ ( (72 — 1) Sh (24) fo (La) vee Png (Gn-y) dz, dz, 


ditns} din. 


In this case the (n — 1)-tuple integral decomposes into the product 
of» — 1 simple integrals, and, therefore, 


=n = 
My = > \ LiF (25) I] F ; (xj) day 
i=x={ —o i<j<n 


y 2 


20) Ayptied Problems in Probability Theory 


Where /°; (z;) 1s the distribution function of the random variable X, 
G7 = (1, 3 , #) of the arcument z; By analogy we find that 


al x 
MEYI= D>) | zin(z) |] £, (x) az; Var [Y}=M[¥?2]—mi 
7=[ —vo fajn 


I~; 


If the random variables A,;@=1,2,  ., m) have the same distrib- 
ution with density f (xz) and distribution function F (x), then 


4) 


My n | f(x) [f (2)]*"' dz. 


re 


M(¥*} and Var ik] can be ealculated by analogy 


oc 


M[¥?] =n \ E’f(aylF iz} dx and Var [YJ] = [¥?2]— mi 


— fe 


7,63. A device (designed as a maximum voltmeter) registers tha 
larger of two voltages V, and Vz The random variables V, and VY 
are mutually independent and have the same density { (v) Find the 
mean value of the voltmeter reading 1e of the random variable ¥ = 
max{V,, V2}, if f (vb) = Aen-d (v > 0} 1s an exponential distributron 
With parameter 3 


Solution. In accordance with the solution of the preceding problem 


ma 


MIVI=2 | vf) Fv) do =o | ave (1 —e=a0) ay 
i} 


— xt 


cu} 


—? { Ave-4* dp — 94. vem cAP Fy 
. : 


It can be seen that Af [V) 1s 15 times as Jarge as the mean values of 
etther 1, or V 
#64 The mean value and the variance of the sum of a random number 
Y 
of random terms A random variable Z 1s a sum Z == » X;, Where the 
i—4 
random variables X, are independent and have the same distribution 
With mean value m, and variance Var,, the number of terms Y is an 
integral random variable which does not depend on the terms X,, has 


a mein value m, and a variance Var, Find the mean value and yariance 
of the random varlable 7 
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Sclution. Assume that the discrete random variable Y has an ordered. 
series 
aS fas ees oes ee 


Py { Po |---| Pade | 


We make a hypothesis {Y = k}. On this hypothesis 
R 


M[Z|Y=k]=)>) M[X,)=km,. 
4 


I 


By the complete expectation formula 
M (Z] = Di kpym, = my 2) kp, =m,M [Y]= mymy,. 
h h 


Similarly, the conditional second moment about the origin of the 
variable Z 


M[Z2|Y=k]=M ‘(> x,) ]=M ee Xi+23) XX; | 


—— 


h 
= 21 @(X1+2 21 MM = kote [X] +h (k— 4) m?, 
i= i<j 
=k {Var,,-}-m3] +k (k—1) m2=kVar,,-+ k2m2. 
By the complete expectation formula 


a, [Z[ = Var, >) kp, + m3, ps kp, = Varymy aia Mx, [Y] 
h R 


pe 2 i eee = yp aL 
= Var,Mmy + Mx (Var, + my) = Var,m, + m; Var, + mim, 
Var [Z] = a, [Z] — mimi, = Var,m, + mx Vary. 
Thus we have 
mM, = myzmy, Var, = Varyzm, + me Vary. 


= the random variable Y has a Poisson distribution with parameter a, 
then 


mM, = amy, Var, = a (Vary + m2). 


7.65. A message is sent over a communication channel in a binary 
code consisting of n symbols 0 or 1. Each is equally probable and in- 
dependent. Find the mean value and variance of the number Y of changes 
in symbols in the message as well as the maximum practically possible. 
number of changes. 

Solution. Let us consider the » — 4 changes from one symbol to the 
next to be rn — 1 independent trials and consider, for each of them 
a Variable X;, which is the indicator of a change of symbol. This value 
IS cqual to unily if a symbol is changed and to zero if there is no 
change, 

n—{ n—-{ 
X=: §) X; M([(Xj= ¥ 
j= | 


i= ? 


n—-1i 
M [X= 2 p=(n—1)p, 
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where p 1s the probability that a symbol 1s changed at a given (th) 
interxal Similarly 


t~t 


Var [A})— pa Var fX,)=(n— th p(i— Pp) 


It 1s evident in this case that p= 1/2 and M[X] = {x —1)2 
Var [X] = (n — 1)/4 By the three sigma rule Xmagy = (n — 12 + 
3 in — 41/2 

766 A group of four radar units scans a region of space in which 
there are three targets 5,, 8, 8, The region 1s scanned for @ time T 
During that time each unit independently of the others, may detect 
each target with probability p, which depends on the ordinal number 
ofthe target and transmits its coordinates to the central control station 
Find the mean value of the number of targets A whose coordinates 
will be registered at the station 

Solution We designate as X; the indicator of the event A; = 
{the ith target is detected} 


x... fi if the ith target 1s detected 
a {0 if the rth target is not detected (: = 1, 2, of 


The mean value of the random variable A, 19 M[X,J=P {the ith 
target is detected} = 1—(£— p,} 
3 


Since X== >} X,, 1t follows that 
i==4 


3 3 
M{XI= 2; [1—~(—p)l=3—D (1— py) 
i= { i-T 


7 G7 The conditions of the preceding problem are changed 56 that 
the probabilities of detecting a target by different units differ the sth 
5 oa the ith target with probability pip (} = 1, 2, 37 = 


SI & 
ANS er M(X)=3— >) Ll (f— Diy) 
ri orl 


768 A radar installation scans a region of space in which there ar6 
four targets Depending on the tyme of scanning the probability of 
detecting a target 1s a function p (¢) and does not depend on the detection 
of the other targets Find (tf) the mean value of the time 7, 1D which 
at least one target wilh he detected and (2) the mean value af the time 4 
in which all the four targets will be detected 

Solution (1) The probability that not a single target will be detected 
tn tame 18 [1 — p (#)]* the probability that at least one target will be 
detected in that time is 1 — [4 — p (t)}! This 1s simply a distribution 
function F, (t} of a random variable 7, As we proved in Problem 5 28, 
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for a nonnegative random variable 7, 


M(f= | U—Fi@idt= | 1—p@yade. 
0 0 


(2) The probability that all the four targets will be detected in time ¢ 
is [p (t)]4. This is a distribution function F, (¢) of the random variable 
T,. Its mean value is 

MIZJ= {UF @lde= | AP OY at. 
0 0 


For example, if the probability p (¢) is defined by the formula p (f) = 
{—e!, then 


OS OO 


; . 1 
M [T= | [1—(1—e-a) dt = | ett t=, 
0 


0 


ry 25 
MITiJ= | (1—-U—e-#tys] t= 
0 


In this example the mean time of detecting all the four targets is 
eight times as long as the mean time of detecting at least one target. 

7.69. We make nm trials in each of which an event A may or may not 
occur. A random variable X is defined as the number of occurrences of 
the event A in the whole series of trials. Find the mean value of the 
variable X. 

Solution. We represent the variable X as the sum of m random variable 


A; ((=1,..., n), where X; is the indicator of the event A in the 
ith trial: 


: 1 if the event A occurs on the ith trial, 
XN; = 
Q if the event A does not occur on the ith trial. 


Tt Ti 
X==>) X; M[X]=)>) M[Xq, 
MIX,] = Pi, Where p; is the probability of occurrence of the event 


On the ith trial. Thus we have 


Tt 


M [.X] = 2 Pj. (7.69.1) 
In particular, if p, = p. =... =p, then 
MIX] = np. (7.69.2) 


It should be emphasized that for formulas (7.69.1) and (7.69 
69. .69.2) to b 
applicable, the trials need not necessarily be Ee pene cig ilies 
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7.70. Considering the trials to be independent, under the condition 
of Problem 7 69, find the variance of the random variable X 
Solution. By the theorem for the addition of variances, 


Var[+A]= Var > X,| = bay Var [A,]. 
i=1 = 


The variance of the indicater of the event A in the rth trial (see formula 
(4019)] 1s p, (1 — p,), then 


Var[X}= >) p, 1p). (7 40 f) 
=i 
In the particular cate When py = ps — == Pf, == Dy 
Var {XI — np di — p) (7 70 2} 


It should be emphasized that formulas (7 70 1) and (7 70 2) can he 
used only for independent trials 

7.71 We make v independent trials in each of which an event A 
ma occur or not occur A random variable X 1s defined as the number 
of occurrences of the event A Fined Its variance 


Solution X= > X, where X, 18 the mdicator of the event 4 im 


=1 
the ith trial By the general formula (7 0 28) for the variance of 
random vanables, we have 


Var {X]= 2) VariX;)+2S Cove.) 
i t=) 


where COVE x is the covariance of the random variables X, and A; 
Covsie,= “1 fA, X J — MEX.) MIX;) 


The variable X,;X , turns into umity only if X,; = t and X, = 1 fe the 
event A occurred both on the rth and on the jth trial} M [X,X 3! = Pip 
where p,; 18 the probability that the event A occurred both on the 
tth and on the jth trial Coy xx, = Ply — PiPy hence 


iT 


VariX}= pi (i—p,) 22 (Puy PuPs) (7 71) 
= i<J 


Thus im order to find the variance of the number of occurrences 1 
an event in» dependent trials, it 1s not suffierent to know the probability 
p, ol the occurrence of the event in each trial, ut 1s alse necessar} %0 
know the probability p,, of the simultaneous occurrence of the event 
in each parr of trials 

In particular, when py, = p, = = p, = p and when pi; does 


not depend on z or / and 1g equal to P, formula (7 71) assumes the 
orm 


Var [X] = mp (1 — p) + n(n — 1) (P — 3’), 


Ch. 7. Characteristics of Functions of Random Variables — 209 


where P = p;; is the probability of the simultaneous occurrence of the 
event in any pair of trials. 

7.72. There are a white and b black balls in an urn. We draw k balls 
at random. A random variable X is the number of white balls among 
the drawn balls. Without resorting to the distribution of the random 
variable X (hypergeometric, see Chapter 4), find the mean value and 
variance of the random variable xX. 


h 
Solution. X=> X;, where 
i=t 


1 if the ith drawn hall is white, 
Ai = {6 if it is black. 


R 
M{X]= >) M[X,)=&p, 
is | 


where p is the probability of drawing a white ball; 
p =al(a + 6), M{X] = kala + 3). 


We seek the variance of the random variable X as the variance of 
the number of occurrences of the event in k& dependent trials [see 
Problem 7.71): 


Var{X]=kp(1—p)+k (k—1)(P — p’). (7.72) 


Let us find P, which is the probability that some two drawn 





: i Aeeae Du -. a— 4 feces 
balls (the ith and the jth) are white: P= Pao ere eae Substituting 
this expression and p= = inlo (7.72), we obtain 

ep ee 4) {4% __ ab a® 

Var[4]= apo the 1) (= to) 


7.73*, A train consisting of m carriages arrives at a railway shunting 
yard. Out of these carriages m, are bound for A,, m, are bound 
R 


for Ao,.. ., mt, are bound for A, ( >; m;= m). The carriages are located 
i=! 

at random along the train and irrespective of their destinations. If 
two adjacent carriages have the same destination, they should not be 
‘ncoupled; if their destinations are different, then they are uncoupled. 
Find the mean value and variance of the number of uncouplings that 
must be made, and also estimate (using the three-sigma rule) the range 
of the practically possible number of uncouplings. 

Solution. Let us consider the m — 1 couplings of the carriages to be 
m — I possible positions at each of which the carriages may be un- 
coupled or not. We designate as X the number of the uncouplings and 
the number of “nonuncouplings” as Y; Y = m —1 — X. It is easier 
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to manipulate the random variable Y,. We represent it as the sum Y = 
m=] 

>) Y,, where 

i=t 


, 1 af there 1s no uncoupling at the ith posttioa, 
res {0 if there 18 an uncoupling 


(the indicator of uncoupling at the ith position), 


rt = | 
By the theorem for the addition of expectations, M{Y] = 2 M (Yi: 


MY i] =¢@ where g, 13 the probability that there 15 no uncoupling at 
the z:th position All the positions are under identical conditions %= 
Jo = = m-)=¢ The probability 7 that there 15 no uncoupling at the 
ith position 18s equal to the probability that twa carriages correspond- 
ing to the ith position have the same destination Adding up the 
probabilities that these carriages are bound for the ist, the 2nd, . ; 
the Ath point of destination, we find 


F R 
__ ATE (it — {} _ 1 __ 
a= ys “a (m1) mim 2) a my (™i— 1s 


poi 


h h 
NI (Yj) > Ht, (m— t= >; m, (m,— 1). 
~1 


m (mi — 1) 
1 1 


Hence 


A 
1 
M | YJ=m—1—— > my (rte, —~ 1} 
=f 
Since the variables X and Y differ by a constant, Var (X] = Var [Y]. 


The variance of the random variable Y can be found from formula 
(? 0 28) for the variance of the sum 


m— i 


Var(¥|= 3, Vari} d+2 2 Covy,s, 
i= t= 


The covariance of the random vanables Y, and Y;, can be found 
from the formula 


Covy ,,=M/¥.¥,]—MIF MY =MiYi¥yl—? 
The product Y;¥, 1s zero if there 1s an uncoupling at least af one post 
Ben and 1s equal to unity if there 1s no uncoupling at either position 
ence 


COVyy, = PY; = {, Y; = 4} a ¢ 
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We seek the probability that there is no uncoupling at either position 
(i or j). This probability is different when the positions are adjacent 
(j — i = 1) and not adjacent (j — i > 1). We designate the probability 
as gq When the positions are adjacent and as q,,,4 when they are not 
adjacent. The probability that there is no uncoupling at two adjacent 
positions is equal to the probability that the ith, the (@ + 1)th and 
the (i + 2)th carriages have the same destination 


R 


h 
mj; (m;—1) (m;—2) 1 
Yaa = D1 r= amb 2m; (m;— 1) (m;—2). 
iz: i= 

For two adjacent positions M[Y;Y;]=¢aq, Covy,y,=daa—@*. The 
probability that there are uncouplings at two non-adjacent positions 
(j-i>1) is equal to the probability that each pair of carriages, 
between which this position is, has the same destination. This may 
happen either if all the four carriages are bound for the same place 
(the Ith), or if the first pair is bound for the Zth place and the'second 
pair for the rth place. The probability of the first variant is 
my (my — 1) (my—2) (mi —3) 

m {m—1) (m— 2) (m—3) 
Tee. The total probability that there is no uncoup]- 


ing at two non-adjacent positions is 


k 
1 
dn.ad = Ty (m—1) (m—2) (m—s) 21 | m, (™m, — 1) (m,— 2) (m,— 3) 


and that of the second variant is 


The covariance Cov, .,, for two non-adjacent positions is 9,24 — 9g? 
7 ivy pace 
\W ith due regard for the number of adjacent (m — 2) and non-adjacent 
(C.-, — m + 2) pairs of positions, we obtain 
Var [X] = Var [Y] = (m— 1) q(1—9) +2 (m—2) (qaa—@?) 
+ [(m— 2) (m—3)—2(m—2)] (Qn.na—@), Cg =O, = VY Var [Y]. 
The range of the practically possible values of X is M [X] + 80,. 


Remark. The calculations only have sense for m >> 3. If in the formulas for 


fad and gpy.aqg some of the terms are negative, then the correspondin m 
assumed to be zero, ' siete: 


fa), A number of trials are made, in each of which an event 4 
(‘success’) may occur or not occur. The probability that the event A 
occurs at least once in the first m trials is defined by a nondecreasing 
function R (m) (Fig. 7.74)*). Find the average number of trials which 
Will be made before a success is achieved. 


") The function R (m) is defined only for an integer m b m 
a * , | ut to 
Clearer, the points in Fig. 7.74 have been connected by lines. cee 
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Solution, Let us assume that the trials are not terminated alter a 
success is achieved Each of them (except for the first} can be “necessary” 
uf a success 15 not yet achieved, and “superfluous” if a success is achteved 
Let us connect a random variable X; with each (ith) trial and assume 
it to be unity if the trial 15 necessary and zero 1f 1t 1s superfluous 

We consider the zandom variable Z, the number of trials which mw} 
be made before a success 1s achieved It 1s equal to the sum of all tha 
randam variables X,, the first of which X, is always equal to unity 

(the first trial 1s always necessary) 


Z=ky+ 2, X; 
The ordered series of the random 
variable A; (2 => 1) has the form 
0 | i 


A ne ge 
, ) RG—1) | 1 (i— 1} 





(if a suceess 18 achieved in the pre- 
ceding i —1 trials, the ith trial is 
superfluous, if it 19 not, then the 
trial 1s necessary) The mean value of the random variable A; 13 


M/(X,J=0 R@—1)4+ 1 [1—RG—1))=1-—-R (1) 


We can evidently use the fsame notation for M [{X,]=MI[!}- 
1—#(0) (R(0)=0) Hence 


Fig 7 74 


Ve 


MIZ}= 2 -RO—1= 3B 1 RW) 


7./0* For the cand:tions of the preceding problem find the variance 
oI the number of trials needed to achieve a success 

Solution The random variables X, Xo, , eG; are mutually 
dependent, and we cannot, therefore, simply add their variances to 


gether We must find the second moment about the ortgin of the 
yariable Z 


Wizj=M{[(> xX, VIaM CS Ag+ 2M iy X,X, 1, 


tax 
WMIAG]— 1° [1-—Re -1J—=1—RG-1) 
dhe variable X,X, 1s unity if X; and A, are both unity, 1¢ both 
trials {the zth and the jth) are necessary For the two trrals (the ith 
aud the 7th) to be necessary, a later (7th) trtal must be necessary 
MIA AY = PUR, = 4, KX, = tp = 1-—-By-— 
Hence 


ha) 


M [Z2] = >) (1—-RO—~M1+22) 1-RG~ 1] 
i 


tl 
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The last sum can be calculated as follows: we first fix 7 and take a sum 
over i from 1 to j — 1; then we take a sum over j from 2 to oo. Under 
the summation sign over i, for a fixed j, all the terms are equal and 
do not depend on i; their number is equal to 7 — 1. Therefore, 


co j-l 
> 2—-RG-D)I=DB DY U—-R (j--1)) 
I< j=2 i=1 


=>; (—1t)M—R(G—1)) 


j=2 
= > k[1--R(A)]= Dd) k[1—R(A)]. 
k=1 k=0 


Hence 


Var [Z) = Dy U-RW1+2 Y RU-RHI-CY UB YP. 


7.76. The probability that a target will be detected by a radar in- 
stallation increases exponentially with the number of surveillance 
cycles n: 


P(zy)=1—e" (O— ao < 1). (7.76) 


Find the mean value of the number of cycles X aiter which the target 
will be detected. 
Solution. Setting @ = 1 — p, we rewrite formula (7.76) as follows: 


P (n) = 1 — (1 — p)". 


We can see that the cycles are mutually independent and the prob- 
ability that the target will be detected in each cycle is p = 1—a. 
Under these conditions the variable X has a geometric distribution 
beginning with unity, and its mean value 

M{X] = 1/p = 1/(1 — a). 
We can obtain the same result using the solution of Problem 7.74: 


oo 


M[X]= >) [1—P(]= >, a* = 1 
k= 


4—a 
h=0 0 





7.77, A radar installation scans a region of space in which there are n 
targets. During each surveillance cycle the radar may detect a target 
(independently of the other targets and other cycles) with probability p. 
How many cycles will be necessary (1) for the probability of detecting 
all the targets to become no less than P, and (2) for the mean number 
of detected targets to become no less than a given number m <n? 
14-0575 
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Solution. (1) We designate the probability of detecting all # targets 
in &A cycles as G, (k), G, “) = [G (k}]", where G (£) 18 the probability 
of detecting one target at least once in & cycles G (k} = 1 — (1 — py’, 
whence G, (k) = [1 —- (1 — p)*} We set = G, (k) > P, 
(1~(i-~p PSP, (fi-peci-VYP, klog (i—p)< 
log 1 — 7 P) Since log (1 — p) <0, the sign of the product 
resulting from the multiplication by this expression 18 reversed, hence 


ke > log (1 — 9/ P)/log (1 — p) 


(2} By the theorem on the addition of expectations, the mean nembet 
of targets M{X] detected during 4 cycles is 2 [1 — {1 — p)"] Setting 
n{i — (i — py") Sm and solving the inequality for k, we obtan 


k Slog (1 — =) flog (t— 7). 


7.78* We make nv independent trials under different conditions, 
the probability that an event A may occur on the first, the second, and 
so on, trial 1s p,, Pe. _ 2, We must find the mean value and varrance 
of the random variable X, which 1s the total number of occurrences of 
the event 4 To simplify the calculations, we average the probabilities 
p,; and replace them by one, constant, probability 


p=— > Pi 
imi 


Will M[X] and Var [X] be calculated correctly? 
Solution. M{X] will be calculated correctly 


7 Tt 
M [Xj=np= > p, =D) 
ii i= 


As to the vanance, it will be overestimated To prove this, we com- 
pare the approximate expression for the variance 
th 


Var, = npg, where q==1— p= < >; (1 — p4) 
with its exact value 


Vare= 21 Pip where q,—1—p; 


We transform the sum in two ways 


2, (Pi-—P) (3 gy = », PiQi~ Py Pia yy Prt RPE 


i— 


71 
= 25 Pudi "P94; 
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3 (pF) (a- 9 =D, (Pr -P) (1 Pi—1 +7) 


=—2 (Pi—P)? <0. 
Ilence 


yy Di; — npg = Varg— Var, < 0; Var, > Var,, ' 


i= 


and that is what we wished to prove. Note that the equality in Var, > 
Var, is attained only for p,} = Pp = ..- = Pa = P. 

7.79*,. Prove that if X,, Xo,..., Xp are mutually independent, posi- 
tive and similarly distributed, then 


R Tr : 
M| > x,/ > X, |=. 
i=1 i=} 


Solution. Since all the variables X,, X., ..., Xn are positive, the 


denominator never contains zero. By the theorem on the addition of 
expectations 


i=0 


R me k n 
M| > x,/> x; |=) M| x./> X;|. 
iA i=t i=! 


Since all the variables X,, Xo, .--, Xn have the same distribution, 
we have 


M rx, 3 x,|=M [x_/ > x; 
j=1 j=t 
lor any i and m. We designate their common value as a 
u[x,/> X,;|=a (i=1,2, ..., n). 


At the same time it is clear that the sum of all the variables of the 
rf 
form X; | > X,; is equal to unity, and, consequently, the mean value 


" j=1 
iS also unity: 


M [> x3, X,| => M [x,/> X,| = 1 


{4 
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Replacing the etpression under the sign of the mean value by a ne 


get >) a-==na=i whence we have a-=1/n Consequently, 
1 


A ft k rt A 
=| j--1 i=} g=il i=] 


and that is what we wished to prove 
780 There are n loads whose energy requirements per unit time 


are independent random variables X, A, A, With the same 

(arbitrary) distribution We consider a random variable Z;= 
Tl 

X/)) X01 7), which is the fraction of the total consump 
=1 


tion of energy taken by the ith load Prove that for any 2 the meat 
value of the random yariable 2, 15 1/n 

Solution, It 1s clear that the mean value of the variable 4; exists 
since it is included between zero and unity The distributions of all 
the random variables Z, (i = 1 nm) are the same (since the problem 
is completely symmetrical) and their mean values are equal M [Z,] - 
M (Z,} = = M[Z,] Since the sum of all the random variables 2; 
13 equal lo unity the sum of their mean values is also equal to umty 


M (> Xil= 22M [ZjJ=1 we aAl[Z=1, 


VW {j4,;]) = tn i=] , He 


7 81 An equilateral tmangle with side a = 3 cm can be constructed 

by drawing a line segment of length @ from an arbitrary point 0 then 

drawing another line segment a at 60° to 

the first and connecting the endpoint of 

the second line to the omgin (Fig 7 81) 

The segments of length « are measured 

x a with a ruler graduated im maullimetres 

The maximum possible error ts thus 0 o mm 

ox &p? The angle 15 constructed with a protractor 

n With a maximum possrble error of 1° Using 

a the linearization method, find the mean 

rKie 781 value and the mean square deviation 0 

os the length of the third side X 

Solution We designate the actual length of the first side as X, that 

of the second side as X, and the actual angle as O These random varia 
bles can be conssderad te be ocataaily mi@ependemt We bare 


A= V X? 4. X?—2X,X, cos © 
Using the linearization method, we find 


My = V mi, + Mig 2My Wiz, COS Mg, 
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where = Mz, = Mzg = 30MM, cosmyg= 0.5, whence m, = 
VY 900+ 900 —900 = 30 mm. Furthermore, 
( = | =( f 224 — 2X, c08 D ) ei, 
ac, m—\ 2 Veep tae, ose Im 
(==) af 2% — 2, cos B a 
ia) m (2 Tapa tee ae IE 
(= | =(+ 22,25 sin 0 eo? 1 Deion, 
OD Im 2 V 22-22 —2z,2, cos G /m 2 


We calculate 


Ox \2 dx \2 Ox \2 
Var,. my be. Vary, = (+=). Varx, + (a). Vary. 


We do not know the variances of the arguments, we only know the 
maximum practically possible deviations of their mean values: Az, = 
Ar, = 0.5 mm; AO = 1° = 0.01745 rad. Setting approximately o,, = 
Gy, = Az/3 = 0.167 mm, 

Var,, = Var,, = 0.0278 mm?, 


fe 
Oy = AW3 = 0.00582 rad, 
Var, = 3.39-10-5 rad, we === h 
get Var, = 0.25-0.0278-2 + 


675-3.389-10-5 ~ 0.0368 mm?, 
0, + 0.192 mm. Fig. 7.82 

7.82. The distance D from 
a point O to an object R is 
defined by measuring the angle @ at which the object is seen from 
the point O (Fig. 7.82), and then, given the linear dimension of the 
object X, and assuming the angle a to be small, the distance is found 
from the approximate formula 


D = X/{2 sin (a/2)) ~ X/a. 


The linear dimension of the object X, as seen from the point O, may 
change, depending of its accidental rotation, in the range from 8 to 
12 m. The angle a is determined to within 0.0001 rad. The distance D 
is large as compared to the size of the object X. Find an approximate 
wean square deviation op of the error in determining the distance D 
Hf the measure of the angle « is equal to 0.001 rad. 

Solution. Using the linearization method, we have 


oD \2 @eD\2Im 
>’ SEE —_—e 2 — 2 
CD (sz), + (Sp). oe. 


We assume the linear dimension X to be uniformly distributed in the 


imterval (8, 12): o, = (12 — 8)/(2 V3) = 2/73 m, of = 4/3 m?: 
mM. = 10 m. Furthermore, 


ZO 


{ Pp 
G, = 0.0001; of =— 10°; m,= 0.001, 
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whence 


sb=($), ot (—E]fob= 8 10 


ro 
Sp=—s* 103120 103 m 


#83 There are two almost linear functions of mn random arguments 
= py (A, X, 1 Ay) and Z=,(X, X, , A,) Given the 
characteristics of the system m, Vary, (i = 1, 2, , m) and the 
correlation matrix [| Cov,; |j find an approximation of the covariance 
On: 


Solution Linearizing the functions gy, and pm, we get 


fi 
F040 Mma 3 (BBE), Si 
{=1 
fn 
“4 Q, (iy, hs Ms ) + >) (Se) oF 


whenee 





Cov,,=M[YZ} = uf > (Se) 5 (Se) X,| 
i=] 


Ti 
Py dp, oy op, } 
4 ( On; dn ( Por ),, Vars, Tv 2 ( oz, ),, ( Oxy no is 
= ized 
The last sum contains n (“7 — 1) terms, and each Cov;, 1s associated 
with two of the terms of the sum 


Ofy op, 
( or; ), ( oxy irk Covis and 


Opy ap; 
( oxy be ( oz; ) pp COVEN 
#84 The distance R froma point K to the origin 
can be found in two ways (1) the distances X and 
Vig 7 84 to the coordinate axes can be determined and then & 


cari be found from the formula R, =]/ X*+ Y%, 
or (2) only the distance Y to the abscissa axis and the angle @ need be 
found (Fig 784) and then R can be found from the formula fig = 
Yicos a We must determine which way will lead to the smaller errot 
tf the distances X and ¥ and the angle « ar> found with mutually in 
dependent errors, with the mean square deviations of the errors in X 
and Y being o, = o, and that of the error in the angle being ¢, 
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To do the numerical calculations, we assign values to the mean devia- 
tions of the errors 6, = 6, = 1 mando, = 1° = 0.0174 rad and to the 
mean values of the parameters m, = 100 m, m, = 60 m and m = 
arctan (m,/my) = 59° ~ 1.03 rad. 


0 ‘OR 
Solution. (1) =a = + y 


Yap? OY Varpy 





x" 2 y* 7a e ee 
Var [Rl=(sagr), + (ee) np WHO o,=V Vai [A,] =90,. 
9 OR, 1 OR, _ ysina 
(2) ( dy cosa’ @a costa ° 
03+ ( 


Thus the condition o, > 0, is fulfilled for « > 0. For the numerical 
data of the problem we have : 


Gj=y=im, = ([! ay (a) 


100 \2 1/2 
x [12+ 602 (5-)" 0.01747 |)" =3.9 m. 

7.85. A system of three random variables X, Y, Z has mean values 
m, = 10, m, = 5 and m, = 3, mean square deviations o, = 0.1, 
o, = 0.06 and o, = 0.08, and a normalized correlation matrix 











y* tan? a 
COs? & 





oz) 
cos*a@ /m 





4 0.7 —0.3 
Irii=} 4 0.6]. 
4 








Using the linearization method, find the mean value and the mean 
Square deviation of a random variable U = (8X? + 1)/(Y? + 227). 
Solution, m,, = (3-100 -+ 1)/(25 + 2.9) = 301/43 = 7. 


dub du (8a®-4-1) 2y. 
Gx ~ y®+222 % ay ~  (y®@--227)2 ? 
du (Ba®-4-4) 4z du\ 640 ,,-° 
ae grea Gel aso 
guy 804-10 du\ 304-42 
(= ) =— age = — 1-63 and (=) =a — — 1.95, 
Var [U] = 1.42-0.12-+ 4.632-0.062-+- 4.952. 0.082 
+ 2[—4.4-4.63-0.7-0.1-0.06 + 1.4-1.95-0.3-0.4-0.08 


+ 1.63-1.95-0.6-0.06-0.08] ~ 0.066: o, ~ 0.26. 


7.86. Two arbitrary resistors R, and R, are connected in parallel. 
The rated values of the resistors are the same and equal to m,, = 
m;, = 900 Q. The maximum error in R which can arise when the rosis- 
lors are manufactured is 4 per cent of the rated value. Use the lineariz- 
ation method to find the rated value of the resistance for the two resis- 
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tors in parallel and its mean square deviation 
Solution. H = ae = Pp (Fi, Hy), Hl» — p (Mtr, Hiys) =— 450) (}. 


t 900 py _ G7 
Ory = Ora = 3 “100 =3 Q, ().= (ry-+ re)? L= 4? 
9) (22) 4 
(52) = ory = a * 
dp \- 9 
_ ? 1. pus 
Var [A] = x (5), 08> = 22, 0, Fe 1.06 2 
i 
In this case the maximum error 18 3 2 Q, and that 1s 0.7 per cent (rather 
than { per cent) of the rated value 
7.87. The resonance frequency f, of an oscillatory circuit is found 
from the expression f, = i/{2n VLC), where L is the inductance of 
the circuit and C 1s the capacitance of the circuit Find an appro 
ximation for the mean value of the resonante frequency of the 
circurt and its mean square deviation if m, = 50 nH, me = 200 pF, 
o, = 05 phi and og = 15 pr 
Solution, m,.= 1/(2n V mye) = 1 59 pH. 





OE isn” Qaml 282g Ir my 
of -| — 

( 5 — Ti aftn "tp The? 
7m CRM Tn 2 ne 








4 4 a 
Vary, = (-G1-),, 84+ (Se), B= (a+) 
4 


Fri 


Oy, My, ADP = 1.0-107 uH, 
and this is 0.62 per cent of the rated frequency 


CHAPTER 8 


Distributions of Functions 
of Random Variables. The Limit Theorems 


of Probability Theory 


8.0. If X is a continuous random variable with a probability density f (x), aud! 
a random variable Y is in a functional relationship with it 


Y= oq (4), 


where @ is a differentiable function, monotonic on the whole interval of the pos- 
sible values of the argument X, then the probability density of Y is expressed by 
the formula 


g(yy=Ff (pty) 1’ I, (8.0.1): 


where tp is the inverse of 9. 

If mis a nonmonotonic function, then its inverse is nonsingle-valued and the- 
probability density of Y is defined as the sum of the terms of the form (8.0.1), 
the number of summands being equal to the number of the values (for a given y) of 
the inverse function: 


k 
ge(yy= >) $V: @) 1 POI, (8.0.2): 


i —— 


Where 1, (y), We (y), - - «> Wx (y) are the values of the inverse function for a given y. 

For a function of several random variables, it is more convenient to seek the 
distribution function rather than the probability density. In particular, for a fune- 
tion of two arguments Z == g (X, Y) the distribution function 


G (z)= { \ f (z, y) dz dy, (8.0.3); 
D (2) 


where f (z, y) is the joint probability density of the variables X and Y, and D (z) 
is the domain on the x, y-plane for which @ (x, y) < z. 
_ The probability density function g (z) can be determined by means of differen- 
Nation of G (): g (z) = G’ (2). 

The probability density of the sum of two random variables Z = X + Y is 
expressed by either of the formulas 


g@)= | f@,s—2)dz, £)= | fe—y, vey, (8.0.4) 
Where f (x, y) is the joint probability density of the variables X and Y. 


n particular, when the random variables X and Y are mutually independent, 
then f(z, y) = fy (2) fe (y) and 


g)= \ fr (2) fe(e—a) ar, (8.0.5). 
or = 
e()= \ fy) fe)ay. (8.0.6). 


— 0 
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In that caso the distribution of the sum g fz) 1s called the convolution {compe 
sition) of the distributions of the terms f, (x} and f, {y} 

if a random vartable kas a normal distribution and ts subjected to a Unear trans 
formation, then the resulting random vartlable wiil again Rave a normal distribution 
in particular, 1f a random varnable X has a normal disttibotion with parameters 
m., 0,, then the random yariable ¥ = aX + 6 (where « and 6 are nonrandom) hag 
a normal distribution wrth parameters m, = am, + 3, ay = | alo, 

A convelution of two normal distribution functions J, (z) and fy (y) with charac 
teristics tty, Gg, My, Ty respectively results in a normal distribution with charac- 


€eristics 
mz=rxtmy, tz= ¥ ol+03 (807) 


Tha addition of two normally distributed random variables X, Y with parameters 
tty, O,, my, J, and the correlation coefficient r,, results in a random variable Z, 
wher also has a normal dittributlon with characteristics 


Mz = Mix bly, v; = V 02-0} +2r5,020, (8 0 &) 


A linear function of several independent normally distributed random variables 
i i | 


ft 
>= » mpAy-+-8, 
i=? 


where a;, 6 ate nonrandom coefficients, also has a normal distrebution with pa 
cameters 


n nn 
n= >) fF Hh xy +o, o:= V >> atah ys (2 0 ) 
i=l t=! 
where m,,, 0,, are the parameters of the random variable X, (f= 1, n) 
Ifthe arguments X, X, — , X,, are correllated, then the distribution of the 


dinear function remains normal but has parameters 





Fi Tk 
== + a,mx,+é, = >» aro, 2 > BG cpx Ix Ox 7 (3 0 10) 
i=t =i ici 


where r,,., 13 the correlatzon coeffictent of the variables Xj, Xy (b= 1-1 6 ® 
fi) 

The convolution of two normal distributions on a plane 13 the destribution of a ran 
dom vector (X, ¥) with components X = X, + X,, ¥ = ¥, + Y., where (44, a 
(X,, Fy} ara uncorrelated randam vectors Tate = Taye > ‘yates ST vive — 

A conralution of two normal distributions an a plane results in a normat distrt- 
ution with parameters 


Mx My yy My = my te ty 
oxr= ¥ Ox + x4 y= ¥ ot +03, 7 (8 . tt} 
whence 


When a random point (X, Y), which 13 normally distributed on a plane, rs Pro- 


yected onto the z axis, which passes through the centre of scattenng and af aa 
anrle & to the r-axis, a random pomt % results which has a normal distribution 
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with parameters 
z= Mx COS &-- mM, Sin &, 


‘oy = VY of cos? &-+- 63 sin? &-+- rxySxOy Sin 2c. (8.0.43) 


Probability theory limit theorems form two groups: (1) a law of large numbers, 
and (2) a central limit theorem. The law of large numbers has several forms, each 
of which establishes the stability of the average for a large number of observations. 

{. Bernoulli's theorem (the simplest form of the law of large numbers). As the 
number n of independent trials, in each of which an event A occurs with proba- | 
bility p, tends to infinity, the frequency P# of the event A converges in probability to 
the probability p of the event: 


lim P {|P™—p| <e}=1, (8.0.14) 
T+ Co 


where € is an arbitrarily small positive number. 

2. Poisson's theorem. As the number 7 of independent trials, in each of which 
an event A occurs with probabilities p,, po, ..-+, Pp, tends to infinity, the fre- 
quency P* of the event A converges in probability to the average probability of the 
‘event: 


lim P { 


Ti-> 00 





Tt 
1 
Pe— = Di pil<e}=t. (8.0.15) 
i=t 


3. Chebyshev’s theorem (the law of large numbers). As the number n of indepen- 
dent trials, in each of which a random variable X, with expectation m,, assumes 
4 value X;, tends to infinity, the arithmetic mean of these values converges in 
probability to the expectation of the random variable X: 





lim P 


TL» OO 


< e} =1. (8.0.16) 





n 

4 

nN pb X ~— Mx 
i=={ 


_ 4. Markov’s theorem (the law of large numbers for varying experimental condi- 
tions). If X;, Xg, ..., X, are independent random variables with expectations 
Mis Mxoy ose, My, and variances Var,,, Var,,, -.., Vary, all the variances 
being bounded from above by the same number J, i.e. Vary, <L(i= 4, ..., n), 
then, as n tends to infinity, the arithmetic mean of the observed values of the ran- 
dom variables converges in probability to the arithmetic mean of their expectations: 


n nr 
4 4 
lim p { — > X; ~ > Dj mx; | <e}=1. (8.0.17) 

When the speed of convergence in probability of various averages to constant 
values is to he estimated, Chebyshev's inequality is used: 


P {| X — m, | > e} < Var,/e?, (8.0.48) 


—. : . Q, and m, and Var, are the mean value and variance of the random 
rariable X, 
The central limit theorem has different forms of which we give three. 
41. Laplace's theorem, If m independent trials are made, in each of which an 
pa A has a probability , then, as z — ov, the distribution of a random variable 
, the number of times the event occurs, fends to the normal distribution with pa- 


tameters m=:np and c=) npq (¢ = 1 — p). We can go on from this to calcul 
the probability that the random variable X falls on any interval (a, 6): fora 4 
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ficiently large 7 


PIXE(a Px o (“AE 0 (<==). (8.0 19) 


Instead of formula (8 0 19) ne often utilize the expression fer the probability 
that the normalized variable; 


Z=(¥ ~ mio, = (X — mpl V npg om =0 0, = 1 
(rather than the random variable X fteelf) falls on that anterva] For a sufficiently 


large n 
P {Z€ (a BY} ~ D (B} — @ (a) {3 0 20) 


2 The central limit theorem for similarly distributed terms IH X, Xs 1 ay 
ere similarly distributed independent random variables with mean value m, and 


Ti 
mean square deviation 0,, then for a sufficiently large n, their sum ¥ = \! Ay 


i= 
has an approximately normal distribution with” parameters 
my AM, Oy = V ao, (8 0 21} 
3 Lyapuropvs theorem HE ¥, Xy X, are mdependent random variables 
with mean values my, my, ry and variances Var, YVar,, Vary 
and the restriction 
fi TL 
hm (>) 4:/(>) Varx,)9/?]=0, (8 0 22) 
Tl—* 7] ij 


where 6, = M (|X, 13] 3s satisfied then for a sufficiently large mn the random 
Ti 


varzable Y = > A, has an approzimately normal distribution with parameters 
{=0 





“1 {jo ® 
hy = 2 Mx, y= V/ >, Varx,. (8 0 23) 
i= 


=} 


The sense of the restriction (8 4 223 43 that the random yanables should be com 
parable as concerns the order of therr effect on the scattering of the sum 


Problems and Evxererses 


81 <A continuous random variable X has a probability density 
f (x) Find the probability density function g (y) of the random variable 
F = aX + 6 where @ and & are not randam 

Solution Since the function (t) = az + 4 Is monotonic, we can 
wit femme 4% 4) Tha wisest Sueno vp (yy van be Sound by eee. 
the equation y = az + 6 with respect to x we get p(y) = (y — 5} 
We now find that :p fy) = t/a and |’ (y} | = 4/}a@ }, hence 


g(yy=—-F (4S) (8 4} 
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8.2. A random variable X is uniformly distributed in the interval 
(—n/2, 1/2). Find the distribution of the random variable Y = sin X. 

Solution. In the interval (—z/2, 1/2) the function y = sin x is mono- 
tonic and, therefore, the probability density of the variable Y can be 
found from formula (8.0.1): g (y) = f (bp (y)) | py’ (y) |. It is convenient 
{o arrange the solution of the problem as two columns, writing the 
designations of the functions in a general case on the left and those of 
the specific functions corresponding to the example on the right, e.g. 


f (2) 1/n for x€(—ax/2, 1/2) 
y=9@ (2) y=sinz 

xr=w(y) x= arc sin y 

p’ (y) /V1i—y? 


g(yy=F (bY) WV) | g(y)=1(nV 1—y?) for yE(—1, 4). 


The interval (—1, 1), which includes the values of the random variable 
Y, is defined by the range of the functiony = sin x for x € (~—n/2, n/2)*). 

8.3. A random variable X is uniformly distributed in the interval 
(~m/2, 1/2). Find the probability density function g (y) of the random 
variable Y = cos X. 

Solution. The function y = cos x is nonmonotonic in the interval 
(—/2, 1/2). We find the solution by analogy with the preceding prob- 
lem, only in this case the inverse function will have two values for 
cach y [see (8.0.2)]. We again arrange the solution in two columns: 


f (x) 1/n for x€(—a2/2, 2/2) 
ly = @,(z) y = COs x 
=| bp, (y) Ly = are cos y 
Lt (y) Ly == ATC COS Y 
pis (YES bps (y)| iV 1i—y? 


Rk 
ey)= 2 f (ws (uy) wey) | | gy) = 2/(aV1—y?) for y €(0, 1) 


8.4. A random variable X is uniformly distributed in the interval 
(—z/2, 2/2). Find the probability density function of the random vari- 
able Y= | sin 4 I. 

Answer. g (y) = 2/(n W1 — y*) for y € (0, 14). 

-O. A random variable X has a probability density f (x). Find the 


Probability density function of the random variable Y = |1— X [- 
Pe teva 


*) In what follows, when solving simi] i 

: g¢ similar problems, we shall write everywh 
os expressions for the probability density only on the interval where it ° ieee 
ssuming that it is zero outside the interval. 


F 
bd 


222 Appted Problems in Probability Theory 


Solution The function y = |1— xz] 1s nonmonotonic We find the 
solution by analogy with Problem 8 3 
f(z} f (2) 
y= 9 (2) y= [{—2] 
r= { py (y) t%=1—y 
be (y) T= 1-by 
I, (¥)1 ibs Cy) 1 


i 
gy) AH) Wt | e(=fU—y) +41 +y) for y>0 


86 A continuous random variable XY has a probability density 
fx (t} We consider the variable ¥ = —X Find its probability density 
function f, (y) 


A Answer fy, (¥) —- fx (—y) 
87 <A continuous random variable X 19 unt 
Aon formly distributed on the interval (a 6) (B > &) 


rf I Find the distribution of the vamable Y — —X 
Answer It is untform on the interval (—-f —a) 
88 A continuous random variable X has a 


probability density f, (z) Find the probability 

Fig 8 10 density function f, {y) of its modulus ¥ =| X | 
Answer fy (y) = fz(—y) + fz (y) for y>O 

89 Arandom variable X has a normal distributzron with parameters 
m, Oy Write the probability density function of its modulus Y — 


|X ] In particular what will be the distribution for mm, = 0? 
Answer 


fy (vy) = VE {exp| ~ 2552 ]+exp[—om }} for yo 0 


202 20% 





Ji m.=0 then 





—__* y" 
fy ty) = on V ta exp (—-tr) for y=> 0 

810 A encular wheel fixed at its centre O (Fig 810) 1s rotated 
the rotation being damped by friction As a result a fixed point A 
on the rim of the wheel Stops at a certain heipht 7 (positive or negative) 
from the horizontal line iJ which passes through the centre of the 
wheel The height # depends on the random angle @ at which the 
rofation terminates Find (1) the distribution of the height # and (2) 
the distribution of the absolute value of H 

Solution H=rsin® where the angle @ is a random variable 
uniformly distributed in the interval (OQ 2m) The solution of the prob 
lem will evidently not change if the random variable G 1s assumed 
to be uniformly distributed in the interval {(—n/2 mn/2) then # 18 a 
monotonic function of @ 
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The distribution density of the variable | # | is 


g(h)=(nr yf 1—(+)*)" for —r<h<tr. 


The distribution density of | H | is 


a le 


£y (d) = 2 (ar Vi (=)*\~" . for 0<d<r. 


r 


8.41. A random variable X has a Rayleigh distribution with prob- 


2 : * 
ability density f (x) = “exp (— ai) for «> 0. Find the prob- 


ability density function g (y) of the variable Y = e~*?. a 





i] x 82 
Fig. 8.14 Fig. 8.13 Fig. 8.15 


Solution. On the interval of the possible values of the argument the 
function y = e-** is monotonic. Applying the general rule, we get 











f (2) <r exp (— sar) (2>0) 

y= (2) y= er™ 

t= (y) z=V —Iny 

I’ (y)] (2yV —Iny)* 

£(v) =F ((u)) WI] e@)= zee exp (BE) 
{—292 





= 55 y *© for O<iy<i. 

The graphs of g (y) for different o are given in Fig. 8.44. 
8.12. A random variable X has a Cauchy distribution with prob- 
ability density f (z) = [x (1 + 2*)I"* (~co <2 < oo). Find the prob- 
ability density function g (y) of the inverse variable Y — 4/X. 

Solution. Bearing in mind that des 
function y = 1/x, the in 
solving the problem acc 


pite the discontinuity of the 
verse function z = 4/y is single-valued, and 
ording to the rules for a monotonic function, 
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we pei 


i { 
g(y)=—— a9 or gly}= ny) ( -~ 00 <7 y <Z 00) 
n+] 


1@ the uwerse of a variable which has a Cauchy distribution also has a 
Cauchy distribution 

813 Through a port A on the y axis at a unit distance from the 
origin a straight line AB 1s drawn at an angie & to the y axis (Fig 8 13) 
All the magnitudes of the angle « from —~x/2 to n/2 are equiprobable 
Find the prebability density function g (7) of the abseissa X of the paint 
B where the strarght Inne cuts the abscissa axis 

Solution X = tang this function 18 monotonic on the interval 
—w2<ca<tin/2 We have g(z) =In (1 + 27)}]) (—wo<cr< 
ane the random variable X has a Cauchy distribution 

814 A diserate random variable X has an ordered series 


—2}—1) 0] 4] 2 
or jozlos{os|ot 


(Construct the ordered sertes of the random variables Y = X?-++1 
Z= |X 

Solution For each X we find the respective value of ¥ and Z and 
place them 1m increasing order We get an ordered series 

1; 27 5 O; tt 2 
03|05|02 o3|05/02 


4. 




















815 A straight line AB 1s drawn through a point A with coordinates 
40 1) at a random angle © to the axis of ordinates (Fig 815) The 
distribution of the angle 9 has the form f (@) = 0 5 cos @ far —ni2 < 
<< 1/2 Find the distribution of the distance FE from the line AB 
to the erigin 

Solution We have L = | sin @} The function 2 = | sin & } 18 non 
monotonic on the interval (—n/2 2/2) Applying the usual scheme for 
4 Honmonotenic functien we obtain 


g(j= Tas (arcsin 2) 





or taking into account that cos (aresin 2) = 71 — P we have g {i} = 


{for 2¢(0 4) ie the distance & has a wmform distmbution in the 
interval (0 1) 


816 The radius Ff of a circle is a random vatuable which has a Ray 
lergh distribution 
rl 
f(r)=— exp {—-} for r=>Q 
Find the distribution of the area S of the circle 
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Solution. The function S = nR* is monotonic on the interval of 
possible values R (0, oo) and, consequently, 


1 S 
g (8) = sar EXP (—s5r} for s>>0O, 


i.e. the distribution of the area of the circle is exponential with pa- 
rameter 41/(2m07). 

8.17. A random variable X has a distribution function F (x), and 
a random variable Y is in a functional relationship with it: Y = 
2— 3X. Find the distribution function F (y) of the random variable Y. 

Solution. 


F (y) =P{Y <y}=P(2—3X <y}=P [x >= 


wine {x < 2g} mtar (254) p(x = 254} 


If the random variable X is continuous, then the probability that 
if assumes any particular value is zero, and 


F (yy =1—F (=5"). 











3 
If X is a mixed or discrete variable, then P{X = —¥ \ may be 
nonzero and equal to a jump of the function F(x) at a point 
(2—y)/3. Thus, in the general case, 
Bhat. 2—y ee 2—y 2—y 
Fyy)=1—F (=S4) + lim [F (“34+ 42) —F(254)]. 

8.18. Given a continuous random variable X with a distribution 
function F (x) (Fig. 8.18), find and construct the distribution function 
G (y) of the random variable Y = | X |. 

Solution. For X >0 we get Y = X; 
for X <0 we get Y = —X. 


Gy) = P{Y <y} = P{| X |< y}. 


Fory<0 we get G(y) =0; for 
y >0 we get G (y) = P{-—y << X¥<y}= 
F (y) — F (—y). The function G (y) is 
Shown by a dash line in Fig. 8.18 [it 
then merges with F (z)]. 

8.19. A mixed random variable X 
assumes two values, each with a nonzero Fig. 8.18 
probability: a negative value (—z,) with 
probability p, and a positive value (x.) with probability p.,. In the 
mterval between —a, and x, the distribution function F (x) is contin- 
uous (Fig. 8.19a); 2,<(z,. Find and construct the distribution 
function G (y) of the random variable Y = | X |. 

Solution. For y <0 we get G (y) = 0 (Fig. 8.196); for y > 0 we get 
Gy) = P{i-y << X < y} = F (y) — F (—y). To construct G (y), we 
18-0575 
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must subtract from each value of F (y) the value of the function at the 
pomt —y, which ts the mirror reflection of y about the axis of ordinates 
(see Fig 8195 where F (z) 1s shown by a dash line and G (y} by a solid 
line} The function G (y) will have two Jumps at points z, and 2,, 
which are equal ta p, and p, respectively 


fiz) iy) 





Fig €19 


820 A random variable X has a normal] distribution with pa 
rametersmando (Fig & 20a) Find and construct the probability density 
function g (y¥) of 1ts modulus Y == | X | 

Solution To construct the probabtlty density of the random varuable 
Y, 6 must sum up each ordinate of the distribution curve of f (z} with 





(a) (6) 
Fig 8 20 


the ordinate corresponding to the value of the probability density at tbe 
point x (see Fig 8 202) For m= 0 new density is double the prob 
ability density f (z) (Fig 8 208) 

8 21. A random variable X has a normal distribution with parameters 
m=, o Find end construct the probability density function & (7) 
of the random variable ¥ = X? 

{ ci 
Solution f(x}= sV ts exp (— a ). ¥ =p (AX) —=X* The inverse 


function of y=2? has two values 2,— -—Vy and 2,= +Vy. By 
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formula (8.0.2) 
— ~ 4 1 
KW=1V DRIVE = aAyl? (—4;} 


+ exp (—4,] == xP (— | for y> 0. 





For y = 0 the probability density function g (y) has a point of discon- 
tinuity of the 2nd kind (it tends to infinity, see Fig. 8.21). 


IY) 


f(r) 


\ 
z 


~ 0 f 





Fig. 8.21 Fig. 8.23 Fig. 8.24 


8.22. Given a continuous random variable X with a probability 
density f (z), find the distribution of the random variable 
+ 4 for A> 0, 
Y =sign X = QO for X=(Q, 
and its numerical characteristics m, and Vary. 


Solution. A discrete random variable Y has only two values: —1 and 
+1 (the probability that Y = 0 is zero). 


0 
P{Y=—1}=P{X<0}= | f(e)de=F (0), 
P{Y= +4}=P(X>0}=1-7 (0), 
my = —1+F (0)-+4-[1—F (0)] =1—2F (0), 
ay (Y]=4-F (0) 4+4-(4—F (0)] =4, 
Vary == G [Y]—my = 4F (0) [1—F (0)], 


where F(z) is a distribution function. 

There is a continuous random variable XY with probability 
density f (x). Find the distribution of the random variable Y — 
min{X, X*}\ i.e. of the variable that is equal to X if X< X? and to X2 
if xix X, 
ibe 
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Solution The functiton y = p (x) 1s monotonic (shown by a solid 
line in Fig 8 28 


x? for z€(0, 1), 
gta= | x for z¢(0, 1) 


Since the interval (0, 1) of the z axis 1s mapped onto the interval (0, 1) 
of the y axis, it follows, by the general rule, that 


fVyW2Vy) for ye (0, 4) 
gy) = f(y) for _-¥'(0, 4) 


824 A random variable X has a probability density f (z) defined 
by the graph (Fig 8 24) A random variable Y ts related to X as ¥ = 
1 — X* Find the probability density function g {y} of the variable ¥ 

Solution The probability density f (x) 1s defined by the function 
fix) = 05 (z + 1) forz € (—1 +1) The function y = 1 — 2? 15 nop- 
monotonic on that interval the inverse of the function has two values 
m=—~Vi-y y2=+V1—y Hence 


gy=(4V 1—y) 11 —V1-—h+U4+V1—y) 





or 
gty)=(2V1—y)! for Omy<t. 


825 A random variable X has a probability density f (x) Find the 
probability density g {y) of its mnverse Y = 1/X 

Solution Although the function y = 1/r 13 nonmonotonic in the 
ordinary sense of the word {for x = 0 1t increases Jumpwise from — 
to +00), its inverse 15 single valued, and this means that the problem 
can be solved in the Same way as for monotonre functions, 


g(y=t(~ mo 


for the values of y which can be inverse to the given set of possible 
values of x 

826 The log normal distribution The natural logarithm of a random 
variable X has a normal distribution with a centre of scatterimg m and 
a mean square deviation o Find the probabrlity density of the vari 
able 

Solution. We designate the normally distributed variable as U 
and have 





UsinX, X=, f(u)=—t—exp[ -4 57]. 


oY on 2o4 
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The function e“ is monotonic: 





4 — (nz—m)2 7 1 

g (x) = oY on exp | 952 | 
ore eee _ (in s—m)" 0. 
= SVE exp | 508 for x> 


This distribution of the variable X is known as log-normal. 

8.27. A spot Sp representing a target on a circular radar screen may 
occupy any position on it (Fig. 8.27), the probability density of the 
coordinates (X, Y) of the spot being constant within the screen. The 
radius of the screen is ry. Find the probability density of the distance & 
from the spot to the centre of the screen. 

Solution. We find the distribution function G(r) = P{R <r} = 
P{(X, Y) € K,}, where K, is a circle of radius r with centre at a point O. 
since the probability density is constant within 
the screen, the probability that the spot will fall in 
the circle is equal to its relative area: 

G (r) = (xr*)/(xrj) = (r/ro)*, whence 
g(r) =G' (r) = ar/r§ for O<r<ry. 

8.28. A random variable X is uniformly distrib- : 
uted in the interval (0, 1). A random variable Y Fig. 8.27 
is in a monotonically increasing functional relation- 
ship with X: Y = (X). Find the distribution function G (y) 
and the probability density g (y) of the random variable Y. 

Solution. We have f (x) = 4 for x € (0, 1). We designate the inverse 

function of y = @ (x) as w (y). Since q (x) increases monotonically, it 
follows that g(y) = f (tp (y)) y’ (y) = 1p’ (y), whence G (y) = w (y), ive. 
the required distribution function is the inverse of (in the range of 
possible values of Y). 
. 8.29. To what transformation must the random variable X, which 
1s uniformly distributed in the interval (0, 1), be subjected in order to 
obtain a random variable Y which would have an exponential dis- 
tribution g (y) = AenAv (y > 0)? 

Solution. Proceeding from the solution of the preceding problem, we 
set Y = G-1 (X), where G- is the inverse of the required distribution 
function G (y) of the random variable Y. We have 

y 
G (y) = Ae~A4udy=1i—e-v (y>0). 
0 
_ Setting 4 — e-4v = x and solving this expression for y, we get the 
Inverse function y = —(A)~! In (1 — z). Hence the required relation- 


ship is 
Y=—(Aaytingi-X) (<X <1). 


' 8.30. A random variable X has an exponential distribution fi. (z) = 
= (¢ > 0). To what functional transformations must it be sub- 
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jected to reduce it to a random variable Y which would have a Cauchy 
distribution f. (yy = In (4 -- yl? 
Solution 


F,{z)=1—e *(z>0) Fy ty)=— | arctan yt] 


Setting | arctan y +] =u and solving this equation for y 
we find the inverse function £,* {te} 
yoo Fy! Qa} = tan (nu — x/2) = —cot tu 
From the preceding problem we get 
Y — Fp (Fi (A) — —cot tf — 2 8%) = cote 4% CX > 0} 


8 31 Two people agreed to mect at a certaim place between £2 00 
and 43.00 hours Lach arrives at the mecting place independently and 





Fig 831 Fig 8 32 


with a constant probability density at any moment of the assigned 
time interval The first to arrive waits for the other person Find the 
probability distribution function of the wating tims and the probability 
that the first will wait no less than half an hour 

Solution We designate the arrival times of the two people as fy 
and fT, and take 12 00 as our reference tims Then each of the indepand 
ent random variables 7, and 7’, 1s distributed with a constant density 
in the mena (0 1) A random variable 7 19 the watting time f = 

1" 428 

Lat us find the distribution function G (tj of this varrable We isolate 
on the plane (,0t, a domain PD (t}1n which | 4, — é, | <¢ é (the hatched 
domain in Fig 8 31) In this case the distribution function G (t) 13 
equal to the area of this domam G (i) = 1— (i — 2? —? (2-4) 
whence we have g ft} = 2(1— #8 forO<t<1 


P{T > 1/2} = 1 — G (#2) = 025 


832 A random point (X YY} is uniformly distributed in a square 
K with unrt sides (Fig 8 32a) Find the distribution of the area S of the 
rectangle A with sides X and ¥Y 

Solution We isolate on the z, y plane a domain D (s} within which 
ay <is (Fig 8326) In this case the distribution function 1s equal to the 
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area of the domain D (s): 


G(s)=1— | \ dzdy=1— dx witha 


D(s) s s/x 


Hence g (s) = G’ (s) = —Ins for O<is< i. 
8.33. A random variable X has a normal distribution with pa- 
rameters m = 0, o. Find the distribution of the inverse variable Y = 


4/X. 
Solution. y = (x) = 1/z; the inverse function is single-valued: 


x= 1/y. By the general rule 
ee eee eee ee a eee Sue 
(y) = o Qn exp ( 2y? y* or g (y) 7 oy? V on exp ( sua) . 


for y = 0 the density function g(y) has a discontinuity of the 2nd 
kind (see Fig. 8.33). 

It is interesting to note that the random variable Y does not have 
& mean value since the corresponding integral diverges. 

8.34. A system of random variables (X, Y) has a joint density function 
f(t, y). Find the density function g (z) of their ratio Z = Y/X. 


5(Y) MS Mi ines 
SV : 


Fig. 8.33 Fig. 8.34 


Solution. We specify a certain value of z and construct, on the a, y- 
plane, a domain D (z), where y/z <2 (the hatched area in Fig, 8.34). 
The distribution function 


: 0 oo oo zx 
G (z) = \ \ f(x, y)dzdy= \ dx \ f(x, y)dy+ \ dx | f(x, y) dy. 
D (z) —o cx 0 pan 
Differentiating with respect to 2, we have 


G 00 
g(s)=— | af(x, 2x) axt | af (2, 22) ae. 
0 


-~ OO 
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If the random variables X and Y are mutually independent, then 


f 
g(a) — J xfy(z)fa(ex)det | xf (2) f, (22) ax. 


= fo G 


835 Find the distribution of the ratio Z = Y/X of tuo independent 
normally distributed random variables K and VY sith charactenshes 
m, = my, = 0, Ox, cy 

Solution. We first consider @ Special case 6, = o, = 1 On the basis 
of the preceding problem 


b | oo | 
oa (xifztxF) mame {Ef zEx?) 
y(z)= — | rae dz \ 2 tn 2 dr 
= Get 
{ ( - = ne 7 | sd b 
= \e a aD ms (Cauchy's distribution), 
p 


In the general case the ratio Z = X/Y can be represented as Z = 
(¥",0,)/{X,0.,), where the variables X, = X/o, and Y, = Yio, have 
a normal distribution with variance unity, 
therefore, 


—-——__4t. ae 
g (2) = m [1+ (dxz}*ap4] oy 
In particular, if o,=«a,, thep 
§ (2) =[R (1-24) 


8.36. A candom point (X, Y) 1s untformly 

Fig & 36 distributed in a circle X of radius 1 Find the 

distribution af the random variable Z = Via 

Solution. In this case G (z} 15 the relative area of the domain D(z) 
(Fig 8 36) 





G (z) = ( arctan z+ +} 


whence g (z) == G' (2) = in (1 + 2*}|-) (Cauchy’s distribution) 

8.37. Erlang’s distribution of order 2 Form a convolution of two 
exponential distributions with parameter 4, 1e find the distribution 
of the sum of two independent random variables X, and X, which 
have probability densities 


fi(zp—Ae-*1 (x, > 0), fa (gq) Aer~*e (2, > 0} 


Solution By the general formula (8 0 5) for the convolution of dis- 
tributions we have 
g (z)= \ f(t) fe (@— 24) day. 
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Since the functions f, and f, are zero for negative values of the argu- 
ments, the integral assumes the form 


Zz 


g (2) = \ fy (4) fy (2— 4) dy = * \ e~**1e~*E~™1) dary = M2ze-** (Zz > 0). 
0 


(8.37) 


The distribution with a probability density (8.37) is known as Eriang's 
distribution of order 2. It originates as follows. Assume that there is an 
elementary flow of events with intensity 4 on the ¢-axis, and only every 
other point (event) is retained in this flow, the intermediate points 
being deleted. Then the interval between adjacent events in the so rare- 
fied flow has an Erlang order 2 distribution. 

8.38. Erlang’s distribution of order n. Form a composition of n exponen- 
tial distributions with parameter i, i.e. the distribution of the sum of 7 


X 


1st point /\ nth point 


X; X 
“142 2 (a) " 


A r+ds 
L 
0 pi 


Fig. 8.38 


independent random variables X,, X5,...-, X, Which have an exponen- 
tial distribution with parameter A. 

Solution. We could solve the problem by consecutively finding the 
convolutions of two (see Problem 8.37), three, etc. distributions, but it 
IS Simpler to solve the problem proceeding from the elementary flow, 
retaining every nth point in it and deleting the intermediate points 


nN 
(Fig. 8.38a). X = >, Xi, where X; is a random variable which has an 
ixt 
exponential distribution. We find the probability density 7, (x) of the 
random variable X, first finding the element of probability f, (x) dz. 
This is the probability that the random variable X falls in the elemen- 
lary interval (z, 2 + dz). 

For X to fall in that interval, it is necessary that exactly n — 4 
events fall in the interval z and one event in the interval dx (Fig. 8.38b) 
The probability of this occurrence is 7, (x) dz = P,,44 dx, where P. _ 
is the probability that 2 — 4 events fall in the interval x. But the num- 

er of events of the elementary flow falling on the interval z has a Pojs- 
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son distribution with parameter a = Ax, and hence 





Leyte 
fn (a) d= he-' da, 
4 (he) 
f, (2) =e (x > 0). (3.38 4} 


The dstubution wiih probabilaty density (8 38 i} 33 known as Erlang s 
distribution of order n 

We could seek the distribution function G, fz) for Erlang’s distrib 
ution of order n by integrating (8 38 1) from 0 to x, but it 13 siumpler to 
derive it using the elementary Row again 


G, (iz) = P{X < zp = 1 — P(X > 2} 


For the event {X >> x} to occur, it 18 necessary that no more than 


z-— 1 events fall on the interval z, 1¢. 0, 1, 2, ,n—i1 events, 
hence 
n— | yay 
G, (x)= 1— 2 Mate" (> 0). (8.38 2) 


This expression can be reduced to the tabulated function A {m, 2) 
{see Appendix 2) 


&, (7) =1—Rin—i, AY 


839 Erlang's generatized distribution Fotm the convolution of two 
exponential distributions with different parameters 


Fy(aysAye~**1 (xy > 0), f, (x2) == A,0788*8 (zt, > 0)- 


Solution We designate X = X, + Xg, where X, and Xy have the 
distributions f, (z,), fe (24) 
, In accordance with the general formula for a convolution of distri- 
utions 


oo 


gtzy= } fylt) f, (e¢—2x)) dz, 


But in this case both distributions are nonzero only for a positive value 
of the argument, and this means that f, (z,) = 0 for 2,<(@ an 
f,(t —2z,) =Oforz, > 2 Forzrz>0 


t —A 
g (x) = \ AB AEXLR OTA ~ Hs) dx,= et q 


. fo(ha~Aude — 1] 
0 Fy 
ha— Ay 
(Erlang 5s generalized distribution of order 2) For A, = Ag = A, we cal 
evaluate the indeterminate form and obtain Erlang’s order 2 dustri- 


(z => 0) 
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bution: zs 
g(x) = Mae** (x > 0). 


Remark. We can prove by induction that the distribution of the sum of n inde- 
pendent random variables X,, ..., X,, which have exponential distributions with 
different parameters 4,, ..., Ap, i.e. Erlang’s generalized distribution of order n 
has a probability density 


n n —A 5x 
e 
gn (2)=(—1)" [] 4: >) GO —__ (> 0). 
i=1 jt [|] (Aj—Ay) 
kj 
rf) 
(The notation [] signifies that we take the product of all binomuals of the 
hej 


form }4;—A, for k=1, 2, ...,f/—1,j+4, ..., 2m, ie. all except for Aj; —A,). In 
a special case, when 4;= iA, 


41 
gn (x)= >) (—1)5-1 CHA jem. 


i=1 


. ™ distribution function of Erlang’s generalized distribution of order n» has 
e form 


Th n { —A yx 
—e 
Gn (2)=(—4)"—1 [] 4; DD) —Q———__ > 0). 
i=1 jt Ay [] (Aj—)n) 
k=) 


lf A;=i4, then 


Gp (t) = s (—1)5-1 ch [1—e M4] (cS 0). 
j= 





fsa ..=A, =), we get Erlang’s distribution of order n: 
A (Ax)Pt 
Zn Slade =|) e~Axe= AP (ned, Ax) (x>0), 

x oO 
G,(2) = \ MP (n—4, 22) da=1— \ AP (n—4, da) dr=1—R(n—1, de) (z>0), 

0 x 
Where 

m te R 
P(m, a)= = e~2, R(m, a)= > ay ens (Appendices 1, 2). 
h=0 


8.40. The distribution of the maximal of two random variables. Given 
lwo random variables X and Y with a joint probability density f (x, y) 
find the distribution function G (z) and the probability density function 
§ (cz) of the maximal of these two variables Z = max{X, Y}. 
Solution. We shall seek the distribution function of the random 
Variable Z: @ (2) = P{Z <z}. For the maximal of the variables X¥ 
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and Y to be smaller than z, each of the variables must be smaller than: 
Gizj=P{X<cz, Y<tz}=F (z, 2), 


where 
F(z, y= {{z, y) dx dy. 
Thus, _ 
G (2) = f f(z, y)dz dy. 


To find the probability density function ¢ (z), we differentiate G (z} 
with respect to z which appears im the limits of Integration of the 
double integral We differentiate G (z) ag a compusite function of the 
two variables 2, and z,, each of which depends on z (2, = 2, 2, = 2) 


= z 
dG d G(x) dx, , 866) dy 
g (2) =) ari j | i fl, y) dy |dz} —-7@) ata ir 


Gz, 


= f(z, y)dy+ f(z, 2) dz 


In the special case when X and Y are independent, f(z, y= 
ii (z=) ,.@) we have 


c@=A) \ hwdvthA® | Awaz, 


or, 1N a more concise form, 
& (%) = f, (2) Fy (2) + f, @) F, (2} 

If the random variables X and Y are independent and have the same 
distribution, then f, (7) = fa (2) = f (x) and g (z) = 2f (2) F (2) 

8 41 The distribution of the minimal of tuo random tariables A system 
of two random variables (X, Y} has a jornt probability density f (z, ¥) 
Find the distribution function G (uz) and the probabihty density func 
tion g (uz) of the minimal of these variables GU = min{x, y} 


Solution We seek the complement of the distribution function with 
respect to unity 


1—-G&)=P(U>u) = P{X>u, Y>u} 


This is the probability that the random point (X Y) falls in the domain 
D (u) hatched in Fig 8 44 It 1s evident that 1—G (uy) =i1— F (u, oo)— 
(co, u)+F tu, u), whence Gy) =F (z, co) + F (co, uw) — 
F tu, u) = Fy (tu) + F, uz) — F (u, x) Differentiating with respect to 
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u, we have (see Problem 8.40) 


g(u) =f) +fe(u)— J fw, ydy— J F(x, uaz. 


on OO 


When the variables X and Y are mutually independent, we have 
g(u) =f, uw) 11 — F, wl t+ fh. wu) It — A dl. 


df the random variables X and Y are mutually independent and have 
the same distribution, then f/f, (t) = f, (x)= 
f(z) and g(u) =2f wi —F )l. y 

8.42. The distribution of the maximal and the Yy 
minimal of several random variables. Given n Du G 
independent random variables X,, Xo, ..., Xn 
distributed with probability densities f, (2), 


fo (to), » » «> fn (tm), find the probability density 7 & 
unction of the maximal of them Z= 


max{X,, Xo,-..+, An} and the minimal] of them G 4 i 
OF MI Kay hog Go weed , An}, i.e. of the ran- 
dom variable which assumes a maximum (mini- Fig. 8.41 


mum) value as a result of an experiment. 
Solution. We designate the distribution function of the variable Z 
as G, (z). We have 


G, (2) =P{Z <2}= II] Fr (@), 
where F; (z) = \ f;(z) da, (i=1, 2, ..., 2). 


Differentiating, we get a sum whose every term results from the 
multiplication of the derivative of one of the distribution functions 
Hy (z), F, (z),..., Fy (€,) by the product of the other distribution 
functions. The result can be written in the form 


4 f7@ 7 
gz (2z)= 2 F; (2) II F; (2). 
} 1=1 


j=1 


By analogy, designating the distribution function of the variable U 
a8 Gy (u), we obtain 


G,, (u) = slags 6) [1— F; (u)]. 
Differentiating, we get 
fy (u) 
eul)= 2 array IF 
ixt 


i=1 
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843 There ire nm independent random yariables X,, X, a. 
which have the same distribution with probability density f (z} Find 
the distribution of the maximal of them Z = max{X,, X, . ,X, 
and the minimal of them UY = min{X,, Xa, ; abn 

Solution On the basis of the solution of the preceding probjem 


G, (z) = (F (2))", og, (2) = 2 (F(z) * F (2), 
G,@=1—-H-Fw@, gi=a2li-F @Po sf 


8.44 Three independent shells are fired at an x,y plane Thecentre 
of scattering coincides with the origin, the scattering 15 normal and 
circular, 6, = 0, = o The mt nearest to the centre of scattering is 
chosen Find the probability density function g (r) of the distance 2 
from the nearest hit to the centre 

Solution We have & = min{f,, A, if,} From the solutron of the 
preceding problem it follows that g fr) = 314 — F frp]? f fr}, where 
# {r) and f (r) are the distrtbution function and the probabrlity density 
function respectively of the distance from any hit to the centre of 
scattering 





F (r\)= {—exp fr 
f(r) =—> exp | — i | (r > 0} 


Hence 
a 
g(r) = =F exp [ — 35] (r > 0) 


16 the probability density of the distance from the nearest htt to the 
centre of scattering has the same form as that for each of them the only 


condition being that the parameter o 1s decreased V3 times, 18 Tre 
placed by o = af3 

8 45 Find the distribution g,, (z) of the minimal of two independent 
random variables 7, and T, which have an exponential distributions 


if (#;) = AyemArty (ty _ 0), iP (ts) = Age7 Aste (f5 ae 0) 
Solution On the basis of the solution of Problem $ 42 
Gu (uy = fy (4) [1— F, (u)} + f, (4) (4 — Fy (2)] 


== A 67 41Ma Age t. 4,07 aU @- Ate = {A,-F A.) etOrtage 


1@ the distribution of the minimal of tyvo independent random vat! 
ables which have an exponential distributrons 1s also an exponentia 
distribution whose parameter is equal to the sum of the parameters of 
the initial distributions 

We can arrive at this conclusion much easier if we use the concept 
of a flow of events Assume that there 1s an elementary flow with inten 
sity A, on the ¢, axis and an elementary flow with intensity A, on the 
t, axis We bring these two Rows together on the £ axis, 18 we Super 
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impose them. It is easy to verify that the result of the superposition 
of two elementary flows is also elementary (the properties of stationari- 
ness, ordinariness and the absence of aftereffects are retained). The 
intensity of the combined flow is 4, + A,. The distribution of the 
distance from a given point to the nearest event of the flow is exponen- 
tial with parameter A, + Ap. 

The same is evidently true for the distribution of the minimal of 
any number of n independent random variables which have exponential 
distributions with parameters A,, Aj, ...+, An- It is exponential with. 

Tt 


parameter >, Ag. 


ix! 
8.46. From the conditions of the preceding problem find the distrib- 
ution g, (z) of the maximal of the variables 7, 7’. 
Solution. 


82 (2) = fy (2) Fy (2) + fy (2) Fs (2) = Age4# [1 — 07427] + Age7 227 [1 — e737} 
== Ayo 4s? Age A272 — (Ay Ay) e atA2)z (z > 0). 
This is not an exponential distribution. For 4,=4,=A 
£,(Z) = 2rAem*2 (1 —ew?4) (z>0). 


8.47*, A random variable X which has a probability density / (z) 
is subjected to n independent trials. The results of the trials are arranged 
in increasing order. A series of random variables Z,, Z,,...,;Zp,.- +, Zp 
results. Consider the Ath of them, Z;. Find its distribution function 
G, (2) and probability density function gy, (2). 

Solution. G, (z) = P{Z, < z}. For the kth (in an increasing order) 
of the random variables Z,, Z., ..-, Zn, .. +; Zn to be smaller than z, 


1 “Rk 
It is necessary that at least & of them be smaller than z: 
tt 
Gy, (2) = Dd Pm 
m==R 


Where P,, is the probability that exactly m of the values of the random 
variable A in 7 trials are smaller than z. By the theorem on the repe- 
tition of trials 


Pm=Cr LF (2))" {1 —F (2)]"™, 
Whence 


Gr(z)= Le CHF @)I" AF (yr, 


~ 
4 


where F(z) = | f(a) de. 


m= OO 
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The probability density g, (2) can be found by differentiating this 
etpression and taking into account that 


me al _. =} 
Cm mn —_— (2—-DiG—m (n-—m)! = fh Tia 3 


CSin—mj=nth, (m<in). 
After some simple transformations we obtain 


gy (zh = nChihf (2) (F (2yPt [1 — Fey. 


It is much easier, however, to obtain gy (2) directly, using the follow- 
ing simple reasoning The element of probability g, (z) dz 1s approxim 
ately the probability that the random variable Z, (the kth largest value 
of the varrable X) falls on the interval (z, 2 -+- dz) For this to occur, 
if is necessary that the following events aro superimposed 

(1) one of the values of the random vartable X falls on the interval 
{z, 2 + dz) 

(2) (A — 1) other values prove to be smaller than 2, 

(3) (2 — 4) remaining values prove to be larger than z [we neglect 
the probability that more than one value fall on the elementary interval 
(z, z + dz)] 

The probability that avery such combination of events occurs 18 
fldz (F Gh! 1 ~ F jit The number of combinations is equal 
to the product of the number n of ways 1n which we can choose one value 
out of the nm values to place it on the interval (z, z + dz) by the number 


Ci} of ways 1n which we can choose é—1 values aut of the rematmiog 
7 — 1 values to place them to the left of zs Consequently, 


Gn (2) dz = nCArif (2) LF (2) [1 — F (2) ]"* dz, 
whence 


By (2) = nh tf (2) [F (2)! [4 — Fy 


8 48 There are four regulators (thermocouples) in an electric furnace 
each of which shows the temperature with an error normally distributed 
with zero mean value and the mean square deviation o, The furnace 1s 
heated At the moment when two of the four thermocouples show the 
temperature not lower than the critical temperature T,, the furnace is 
automatically switched off Find the probability density of the tem- 
perature 4 at which the furnace will be switched off 

Solution The temperature Z at which the furnace is switched off 
ts the second smallest (:e the third largest) of the four values of the 
random variable 7 which has a normal distribution with the centre 0 
scattering Ty and the mean square deviation oy 


1 (t—-Ty}4 


The corresponding distmbution function 


F(t) = 0 (=>*)} +405 
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Using the results of the preceding problem for n==4, k=3, we 


obtain - 10 . (t—%)? © f=, 
és(t) = ree exp [— AP] [0 () 


+0.5|"[0.5—@ (=) |. 


8.49, There are n independent random variables X,, X,, ..., Xn: 
whose distribution functions are power functions 


0 for x;<0, 
PF; (x;) = xt for Ocal (i=l, 2, ..., 7) 
f for 2x;>1, 


where k; is a positive integer. The value of each random variable is 
considered and the maximum value Z is chosen. Find the distribution 
G (z) of that random variable. 

Solution. On the basis of the solution of Problem 8.42 


G(z)= |] F;(z)= |] 2" for O<z<, 
i=1 i=1 


or, if we designate k= y, kj, 


= 


O for z<0, 
G(z)= 4 2° for O<z<ct, 
1 for z>1, 


le. the maximal of several random variables, which are distributed 
according to a power law in the interval (0, 1), is also distributed accor- 
ding to a power law with an exponent equal to the sum of the exponents 
of separate distributions. 

_ 8.90. The discrete random variables X,, X,. ..., X, are mutually 
independent and have a Poisson distribution with parameters ay, 


Tt 
Q, ..., @,- Show that their sum Y = 2 A; also has a Poisson 
i= 


tt 
distribution with parameter a= >) q;. 


i=1 
Solution. We first prove that the sum of two random variables 
‘A; and AX, has a Poisson distribution. for which purpose we find 
the probability that X,+X,=—m (m=0, 1, 2, ...). 


P{X,+-X_=m)}= D, P{X, =k} P(X, =m—h} 
k=0 
it i Me 
= 21 ate GT ee 
k=0 


(6~0375 
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Taking into account that CA = ci mf we represent the expres- 


(ra—=ky! * 
sign in the form 


Trl 
—faz+a%) TY 
@ >} Rk A mk (a, -+-¢) =fo,+ 


el 


R= 


and this is a Poison distmbution with parameter a, + ¢@, 

We have thus proved that the sum of two independent random vane- 
bles, which have a Poisson distribution, also has a Poisson distributzon. 
This result can be extended to any number of terms by mduction 

851 A system of random vamables {X, ¥) 1s normally distmbuted 
with characteristics m, my,, dy, d, and z,, Random variables (U/, ) 
are related to (A, Y) as ( =aX + bY + cand V=A*X +1Y +m 
Find the distribution of the system of random variables (U, ¥) 

Answer. The system (©, }) 1s normally distributed with characters- 
ics 


m,=am,+om +e, m,=khm,+bn,+m, 
0,=V ao5 + 6703+ 2aha,0,r xy: 
,= V ho2+ fa? + ZAG OP xy 


akoy-} bia} + (bk-+ al} ox6yrxy 
Cudy . 


Zuo" 


8 52. Form the convolution of two binomial distributions with para 
meters (rm, p) and (k, p} 

Solution Assume that X ts the numher of occurrences af an event A 
in m independent trials in each of which it occurs with probability p, 
X has a binomial distribution with parameters (n, p) Similarly, Y 3s 
the number of occurrences of the event A in A independent trials under 
the same conditions it has a binomial distribution with parameters 
(4, p) 24= X + FY is the number of occurrences of the event A in 4 
series of n + & trials with probability p of the event 4 on each trial, 
the variable z also has a binomial distribution with parameters 
(2 + k, p) 

Note that whereas the probahilit es pare different mn different series, 
the convolution of two binomial distributions results in a nonbinomuial 
distribution 

8 53. Using Chebyshev’s tnequality, estumate from ahove the pro- 
bability that a random variable X, having a mean value m and a mean 
square deviation o, deviates from m by less than 3c 

Solution. Chebyshev's inequality (§ 0418) yields 





DIX 2 4 8 
P {|X —m| 230} = Se, P{|X—m| <3} Sz. 
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Thus any random variable deviates from its mean value by less than 30 
with probability not less than 8/9*?. 

8.54. A large number 7 of independent trials are made, in each of 
which a random variable X is uniformly distributed on the interval 
(1, 2). We consider the arithmetic mean of the observed-values of the 


random variable X: Y = - >; X;. Proceeding from the law of large 


i=1 
numbers, find the number a to which the variable Y will tend (converge 
in probability) as nm —» oo. Estimate the maximum practically possible 
error of the approximate equality Y wa. 
Solution. 


a=M[Y|=— >\ MIXJ=—-n-1.5=1.5, 


i=1 


Tr 

{ 4 4 aE 5 4 

Var [Y] = > > Var [X;] = soem Oy = V Var (Y=. 

i=! 

The maximum possible value of the error is 3oy,. 
8.09. We consider a sequence of m random variables X,, Xo, ...,Xp 

uniformly distributed on the intervals (J, 1), (0, 2), ..., (0, ) re- 

n 


spectively. What happens to their arithmetic mean Y=— >; X; when 


: iz=1 
nh Increases? 
Solution. For a given n 
ji L741. 2. 8 
r i 
M[Y]=— 2 M [Xi] = — (+ $+5+4+ a ++) 
41 n(n+i) _ n+l 
~~ 2n 2 an 


As noo, M [Y] increases indefinitely and there is no Stability 
of the arithmetic mean. 
8.56, Random variables X,, A,, ..., Ay are uniformly distributed 
on the intervals (—1, 1). (—2, 2), ..., (—n, nn). Will the arith- 
nr 
metic mean of the random variables X 1, 1.8. Y = -. > Xi, converge to 


. « » s s * i=! 
Zet0 In probability with an increase of n? 


Se 


* « . 
NE ah the extreme, most unfavourable case. For random variables usually 
pi ee in practical applications this probability is much closer to unity. 
es ance, for a normal distribution it is 0.997; for a uniform distribution it is 
¥. and for an exponential distribution it is 0.982. 
10% 
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Solution M{}] =— >) Wf{A,]=O0 but the random variable Y 


fai 
will not converge to zero in probability since the conditions of Markov s 
theorem are violated the variances of the random variables A, are 
not limited by the same number £ but increase mndefinitely with an 
Increase in 7 
857 A computer produces random binary digits such that the sym 
bols 0 and f maj ippei with equal probability at each position and 
independently of other positions The sequence of symbols ts divided 
into groups consisting of the same symbols say O0011101 
OO 1111 00 11 0000 1 0 The number of «vmbols in each group 
is calculated and 1s divided by the number of groups How wall the 
quotient behave when the number of groups n increases indefinitely’ 
Solution \ random vartable X, the number of symbols in the :th 
gioup has 2 geometric distribution beginning with unity (see Chap 
ter 4) MiA,J—t/p=2 Sar[X,j = gi pt? = 5/0 o* = 2 


lt Y, — y\ Y, then 
—1 


M(¥,]-—n2=2 Var (¥y]=—y-n2— = == 


On the basis of the law of large numbers the variable Y, converges 
in probability to Mt} } — 2asn—+oo lim P{|)¥, —2j< el =i 


By the three sigma rule the error of the approximate equality Y, a a 
does not exceed 3 Y Bin 

858 <A factory shep produces balls for ball bearings The shop 
manufactures n = {0000 balls per sh ft The probability that a ball 
will be defective 1s OGo The causes of defects are mdependent for 
separate balls The ready balis are inspected immediately after their 
manufacture The defective balls are rejected and dumped into a bin 
wine the Sound bails are sent to the assembling shop Find the numbét 
of balls for which the bin must be designed so that 1t 25 not overfilled 
during a shift with probability 0 99 

Solution The number of rejected balls X has a binomial distribution 
Since nis large wecan issume on the basis of the Laplace limit theorem 
that the distribution 1s approvimatel, nermal with characteristzs 
My =P 100390 005=:500 Var, = npg = 500 » 095 = 470 
O, & 

We find the value of 2 sucn that P{Y¥<cf}=—0 99 or 

i—m. i— 50} 
al Ox }+05=0 ( 21 8 }+05=099 

From the tables for the function ® (x) we find (2? — 500)/21 8 we do 
whence | 551 1e¢ the bin, designed for approximately 550 balls 
will not be overfilled during a shift with probability 0 99 
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8.59. There is a queue of 7 = 60 people to the cashier, the payment 
to each person being a random variable. The mean payment m, = 
50 roubles, the mean square deviation of the payment co, = 20 roubles. 
The payments are independent. (1) How much money must the cashier 
have so that all 60 people get their money with probability 0.95. 
(2) How much money b will remain with the same probability 0.99, 
after the cashier pays all 60 people, if ne starts with 3500 roubles? 


Solution. (1) The total payment Y = s; X;, Where X; is the pay- 


i=! 
ment to the ith person. On the basis of the central limit theorem for 
uniformly distributed terms, Y has an approximately normal distrib- 


ution with parameters m, = 3000 roubles, co, = ) 60 » 20 © 154.8 rou- 
bles. We find the necessary initial reserve of money / from the condition 
D[(l — m,)/o,] + 0.5 = 0.95. By the tables for the error function 
(Appendix 5), (1 — m,)/o, ~ 1.65; 1 = m, + 1.650, 3256 roubles. 

(2) The money b that remains with probability 0.95, can be obtained 
by subtracting the sum | found in (1), i-e. b = 3500 — 3256 = 244 rou- 
bles, from 3500. 

8.60". A lottery is organized as follows. The participants buy tickets 
with tables of numbers 1, 2, ..., 90. A participant must choose five 
numbers at random, mark them on his ticket and send the ticket to the 
organizers who store all the tickets till the day of the drawing. 
On an assigned day five different numbers are drawn at random from 
30 numbers and the numbers drawn are reported to the participants. 
Ifa participant guessed less than two numbers (0 or 1), he gets no prize. 
If two of his numbers coincide with two of those drawn, he wins a rouble; 
if he guessed three numbers, he gets 100 roubles, if he guessed four 
numbers, he gets 10000 roubles, and if he guessed all five numbers, 
he gets 1 000 000 roubles. Find: (4) the lowest ticket price at which on 
the average the lottery organizers will not lose; (2) the average income 
A of the lottery organizers when ! 000 000 people participate in the 
lottery, each choosing numbers independently and each buying one 
30-kopeck licket; (3) using the three-sigma rule, find the boundaries of 
the practically possible payments in the lottery; can we consider the 
tn payment in the lottery to have an approximately normal distrib- 
ution: 

Solution. (1) We designate as p; the probability that exactly i of the 
hive numbers chosen by a participant coincide with the drawn numbers. 
We find that 








C2C3. C302. 
Pa SO we 2.95. 107%, pp = we B12 10%, 
30 C30 
3 L.. = 
C30 CR 


The minimum price of a licket must be equal to the mean value of 
pad prize r ceived by the participant who bought the ticket: m — 
sad X 107° 4+ 8.12 x 10-4 x 10° + 9.67 «x 10-6 x 104 + 2.99 y 
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108 «< 408 = 223 8{[0-* roubles, 1e the mmimum price of a ticket 
tis about 25 hopechs 
(2) AF = (0 30 — 0 233) ~ 10° = 77 x 10° roubles 
(3) The total winnings X wlhuch the organizers of the lottery must 
1006 000 
pay is the sum of the winnings of the participants A= > Ay, 


wl 


=I 


wher. X, 383 the amount son by the ith particrypant 

We assume that the participants mark thetr numbers independently 
so that the var:ables A, Gi = 1, 2 , 1000 000) are independent 
We know from the central limit theorem that the sum of a sufficiently 
large number of independent random variables which have the same 
distribution has approximately a normal distribution We most find 
out whether the number of terms nm = [ 000000 15 sufficient in this 
case for the variable A ta be considered normally distrtbuted 

We find the mean value mi, and the mean square deviation a, of the 
random varrable A For any i =i 2 , 1000000 we get m,, = 
223 x 10-=0223 2 f[A,) = 225 1074 812+ 907 x 10 - 
228 x 10'}— 235 0% Var,, = 238 \ 104 — 0 22? = 238 x 10? 
Hence 


m,—10® m, =223 105, Var, = 10° x Va, = 2.38 x 10”, 


o,=10 238 ~154 105. 


We know that for the random variable A, which has a normal dis- 
tribution, the range of practicalls possible values is m, + 3a, In aur 
case the lower bound of the possible values of the random variable X, 
provided that st was normally distributed, would be m, — 30, = 
—2 a9 x 10° The negative value of this bound signifies that we cannot 
consider the random variable A to be normally, distributed since there 
cannot be negative wintings 


Le 
Frd 
8 6f*. Find the limit lim > — e 7, where aisa positive integer 
1 i 
m=O 


{I 
Tl 

Solution. > <0 is the probabrlity that the random sariable 

r=0 
X which has a Possson distmbution, will not exceed its mean 
value @ But as the parameter a tends to infimity, the Poisson dis 
tribution approaches the normal distribution For the normal dis- 
tribution, the probabrlity that the random variable will not exceed 





i 
mm i 
its mean value 18 .:1/2, and this means that lim >) — eo? == — 
ero n=O 
8 62. Independent random variables X,, Xa, . have the same 


exponential distrrbutton with parameter A f (r) = Ae7A* 
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We consider the sum of a random number of these variables Z= 


y 

YX; where the random variable Y has a geometric distribution 
i=t 

heginning with unity: 

P,=P{Y=n=p? O<cp<i;n=1, 2,...). 


Find the distribution and the numerical characteristics of the random 
variable Z. 


Solution. The sum of the fixed number 7 of random variables 


n 
2 X,; has Erlang’s distribution of order n (see Problem 8.38) with 


ixi 
probability density 


d(Az)"-1 
fn (2) =e (2 >> 0). 


The probability density @ (z) of the random variable Z can be found 
from the total probability formula on the hypotheses {Y = n}: 


oo 


= \ (he)\?-2 oe 
9 (2)= >) fn (2) Pn = Dy epg 


n=1 7-21 


= pien*z > Cae)" = phe- Meh? == phe-hee (z > 0), 
R=0 


le. the random variable Z also has an exponential distribution, but 
With parameter Ap. Consequently 


m, = 1/(Ap), Var, = 1/(d*p?). 


8.63. The distribution of the sum of a random number of random terms. 
We consider the sum of a random number of random terms Z = 
y 


> A;, Where X,, X5,.. . is a sequence of independent random variables 
ix i 
Which have the same distribution with density f (x); Y is a positive 
integer-valued variable, independent of them, which has a distribution 
PLY =n} = P, (n= 1, 2,..., N). Find the distribution and the 
numerical characteristics of the random variable Z. 

Solution. We suppose that the random variable Y assumes the value 
Z (n= 1, 2, ..., N) with probability P,. On this hypothesis Z = 


> A;. We designate the probability density of the sum of n independ- 
i={ 

ent random variables X,, X., ..-, Xn, Which have the same distrib- 
ion, as {™ (x). We can find the densities {( (z) successively: we first 
find 72) (x), i.e. the convolution of two similar distributions / (x) and 
t (2), then} 7@ (x), the convolution of f@ (x) and f (x), and so on. 
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By the total probability formula, the probabrht} density g (2) of 
the random variable 2 15 
N 
9 (2) Dd} (2) Pp (8 63 
nmi 
We found the numerical characternstics of the random variable Z 
in Problem 7 64 


M[Z] = m,m,, Var [Z] = Var, m, + mz Vary, 


where m,, my, Var,, Var, are mean values and variances of the random 
1ariables X and Y 

When certain conditions are fulfilled, ~e can assume, with an accur 
acy sufficient fer applications that the random variable Z 1s normally 
distributed with the indicated parameters M (Z], Var [Z] Let us show 
this Without viclating the generality of our reasoning, we set m, = 9 
for the sake of simplicity On the basis of the central limit theorem, se 
can assume for terms having the same distribution (see Sec 8 0) that 
for n> m, — So, > 20 the distributzon density /( (z) im formula 
(863) 15 normal with parameters m™—0O Var!™ = n Var, Isee 
(5 0 33)] 





{ 24 
{vi} = ————— 
j 2) )’ 2nn Var- XP ( 2n Var+ } 

Formula (8 63) expresses the mean value of the function of the random 
argument IV 


N 
9 (2)= Df (2) pa = MFP (2) 
7) 

For functions sufficiently close to linear functions in the range of 
practically possible values of a random argument, we can assume 
that the mean value of the function 1s equal to the same function of the 
mean value of the random argument, ie that 





(70,,) 4 2% 
1 Os ae! ¥ OO  —— —  __ 2 
MIfO%z)) we FM (2) or plz) ze Vian exp | Sm, Vrs 


which ts a normal distribution The approximation 1s the more precise 
the closer to a kinear function the function /(*) (z) of the random argu 
ment Y is in the range of its practically possible values My ob d0y 

Calculations have shown that we can consider this functron to be 
approtumately linear provided that m, — 30, => 20 For example, 1 
the random variable Y has a Poisson distribution with parameter 4 
[see (4 0 26)], then the condition will be fulfilled for a t> 40, uf ut bas 
a binomial distribution with parameters 7, p [see (4 0 24)| fand a small 
parameter p <2 0 1), then xp = 40 Note that in both cases the random 
variable Y (the number of random terms) 1s approximately normally 
distributed with parameters m, — Var, = a (for a Poisson distributron) 
and m, = np, Var, = npg (for a binomial distribution} 
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8.64%. Independent random variables X,, Xz, ..., Xn, -.- have the 
same exponential distribution with parameter 4. A random variable 
Y=U+1, where the random variable U has a Poisson distribution 
with parameter a. Find the distribution and the numerical charac- 

Y 


teristics of the random variable Z= >) X;. 


om — 
Solution. The sum pe X; has Erlang’s distribution of order n 


ix] 
(see Problem 8.38) with parameter A: 


VN (Ax)e-1 
fy (1) =e (w@ > 0). 


By the total probability formula the probability density of the 
random variable Z is 


is = r (Az ad = qn-t _;) 
p(2)= D>) fn(2) Pa= Di er eo are 
n=1 n= 
== Je~*z-a Bi a for z>0. 
k=0 


We can express this density as follows: 
p (z) = Ae~*2-22, (2 VY Aza) for z>0, 
where 
(x/2)7h 


Iy (2) = 2 “DE 
h=0 


is a modified cylindrical Bessel function. Then, from Problem 8.66, 
we have 
M{[Z] — myxmy = (a+ 41)/A, Var lZ] = Var, my +- mz Var, 
= (a + 1)/A2 + a/k? = (2a + 1)/22. 
8.65. Consider a system of random variables X; (i = 1, 2, ..., n) 
related to a discrete random variable Y thus: 
1, 1 2=y 
x,={ . — Fa 
GO; VW to. 
The distribution function F (y) of the random variable Y is known. 
Find the distribution of each random variable X ; and the numerical 


characteristics of the system of random variables (X,, X., ..., X). 
Solution. The ordered series of the random variable X; has the form 
. ! 0 | { 
Vio ee le (eee Oy 2. : 
“lpr<g lpr sg als - 
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Since P{Y <1} = F(t), the ordered series has the form 


| oO; 1 
X,. (+ 
Fin |1—Fip 


whence my =1—F (1), Vary,~ F (2) (1—F (i) 

Let us find the covartances of the random variables A, and XA,, for 
which purpose we determine M[X,X,) Fori<cj the product 4,4, 
can assume only two values viz. 1 rf X;=14, and O rf X¥,;—0 Con 
sequently MYA LX 5} =m, = {-—Ff (7) {i <j), whence Cov = 
MIX,Xj]—m,m,,=1—FU)~U—F WIM -~F (=F OUP 
{<< 7}, and the correlation coefficient 


F 





ree Oe FP J FOF 
Grey OV FO POF) [fF Pi) TF tl * 


8.66. A number of independent trials are made in each of which an 
event A may occur with probability p The trials are terminated as 8000 
as the event A occurs 7 times (nm >> 1) Find the distributron and the 
numerical characteristics of the number X of “failures” mm which the 
event A does not occur 

Solution. We find the probability that the random varrable X assumes 
a value k For that event to otcur, it ts necessary that the total number 
of trials should be equal to nm —- A (A outcomes are failures and mn out 
comes are successes) By the hypothesis, the last trial must be successful 
and in the preceding x» + & — 1 trials mn — 1 successes and & failures 
must be distributed at random The probability of this occurrence 18 


P{X=k}=Chin-ip"g", where g=1—p(k=0, i, -. } 


The distribution obtained is a natural generalization of a geometri¢ 
distribution, we shall call it a generalized geometric disiribution of order 
mz. It 1g a convolution of ” geometric distributions with the same para 

Ti 


meter p X = > A,, where each random variable X, has a geometric 
su { 


distribution 
PEX, =A} = pa* (k= 0, 1,4. we 


Indeed, the total number of fatlures 1s the sum of (1) the number of 
failures till the first occurrence of the event 4, (2) the number of failures 
from the first to the second occurrence of the event 4, and so on Hence 
we obtain the numeme¢al charactemstics of the variable X m, = mq/p, 
Vary = ng} p* 

8.67. The hypothesis 1s the same as in Problem 8 66, except that the 
random variable Y ts the total number of trials (both successful and 
unsuccessful), made till the mth occurrence of the avent A. Find the 
disinbution and the numerical characteristics of the random variable Y. 
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Solution. Y = X +- n, where X is the random variable in the pre- 
ceding problem. Hence 


P{Y =k}=P{X =k—n} =Chip pg?” = Chri pg 
(k=n, n+1, ...). 
The numerical characteristics of the variable Y are 
My = M,+n=ngptn=nip, Vary, = Var, = ng/p’. 


8.68. There is a random variable Y which has an exponential dis- 
tribution with parameter A: f (y) = Ae~4¥ (y > 0). For a given value 
of the variable Y = y a random variable X has a Poisson distribution 
with parameter y: 


P{X=hY=y}=He (k=0, 4, 2 ...). 


Find the marginal distribution of the random variable X. 
Solution. The total probability of the event X =k is 


P{X=h}= | Leet dy= cm | yte-+4My dy 
0 0 
si bh 1 a te k=0, 4,2 
s=gp ALLA! = aap (=O, 1, 2, 


If we introduce the designations A/(1 + 4) = p, 1/4 +A) = gq = 
1 — p, we obtain P{X = k} = pqg® (k = 0,1, 2,...), ie. the random 
variable X has a geometric distribution with parameter p = A/(1 + A). 

8.69. A Geiger-Miiller counter is mounted in a spaceship to find the 
number of particles falling in it during a random time interval T which 
has an exponential distribution with parameter jw. Particles arrive 
ina Poisson flow with intensity 4; each particle is recorded by the coun- 
ler with probability p. A random variable X is the number of recorded 
particles. Find its distribution and the characteristics m, and Var.,. 

Solution. We assume that 7 = ¢ and find the conditional probability 
that Y =m (m = Oe: lise he) 


P{X=m|i}= Lepieht, 


Then the total probability of the event {X =m} 





‘a t dh tym L re = 
P{Xx = im} = \ ( Pr e-*Phie 7M dt = + (ap)™ {Mo —-COptp)t dt 
0 0 


1 (Ap)™ ( hp 
(Ap-+ pymri Apu \ App 


)" (m=0, 4, 2,...). 
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This 1s a geometric distribution with parameter p/(Ap 4+ 1} (see the 
preceding problem) and therefore [see formulas (4 0 30) and (40 31) 


m= (sabe) (sper) - 78 


Var, = (ae) (apts 2 Ap Opty) 
a (<2)? 22 = My Uy - 1) 


870 Solve Problem 869 on the hypothesis that the counter 1s 
switched on fer 1 random time 7 With density f (tf) (¢ >> 0) 

Solution \s in the preceding prablem for 7 = ¢ the conditional 
distribution of the variable ¥ is 


P(X = mt} EPH" APE O(m=0 1 2 ) 


The marginal distribution 
Piva m)— [CPO™ 6 wey (tyat (m=0 12 3 
0 
We find the numerical characteristics of the random vamable \ 
The conditronal expectation Mx) pt the thsolute expectation m,= 


| Apey (f})dt—Ap Ef(t)dit=Apm, where inp —-M[Z] By analogy we 
0 0 

ind the secand moment about the origin of the random variable A 
{note that in this y ty We can only find absolute moments about the 
Origin and not centrs} moments) 


Go [X]t]— Apt + (Ant)? 
mI X]=2 p \ tf (2) dt + (Ap)? \ 12/ (t) dt 


4) 0 
=Apm, -(Ap)ag(T]  Apmy+ (Ap)® (Var, em?) 


where Vai, is the variance of the iandom variable 7 Hence 
Var, —@,[X]—m% =Apm,+ (Ap)? Var; 


S71 Solve the preceding problem for the spectal case when j (t) 18 
Erlang s distribution of order (A + 4) with parameter u 


Ft) — fasy (t) = me e~Ht (t= 0) 


Ch. 8. Distributions of Functions of Random Variables 253 


Solution. 
P(X =m) <— \ (Apt) ope CHORE aah dt 
m! i 
0 
_ p(Apy™p ko—(.pt _ b(Ap)™ wh (m-+h)! 
ee ae fmt e (Ap+p)t dt = - ara eT kl (Kp py mtret 
0 

__ pm UL k+1 Np m 
= Crt eset Peso 


Thus the random variable X has a generalized geometric distribution 
of order k +1 (see Problem 8.6) with parameter 


__ 
Pi Tpe 


The mean value of the random variable 7, which has Erlang’s 
distribution of order k-+-1, is m,=(k+1)/p, and the variance 
Var, =(k+1)/p2. Consequently, from the formulas obtained in the 
preceding problem we have 


nN n 
m, =" (k +1), Vary =? (k+4) (14-2), 


which can be represented, as in the previous problem, in the form 


k-4 k+1 
m,= q,, Var,= ! “ 





g;, Where g;=1—p,-. 


8.72. When physical quantities are measured, the results are usually 
rounded off to the least scale division of the instrument. Then a con- 
tinuous random variable turns into a discrete variable whose possible 
values are partitioned by intervals 
equal to the scale division. The 
following problem arises correspon- 
dingly. A continuous random 
variable X, Which has a distribution 
With probability density / (z), is 
rounded off to the nearest integer; 
a discrete random variable Y = 
V(X) results, where V(X) is an 
inleger nearest to X. Find the 
ordered series of the random varia- 
ble }” and ils numerical character- 
istics, 

Solution. The graph of the func- 
lion V(X) is given in Fig. 8.72. Pig. 8.72 
When the distances from the value 
’i t to two nearest integral values are equal, the rule of rounding off 


is Inessential since the probability that a continuous random variable 
aus in any point is zero. 
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The probability that the random variable Y assumes an integral 
value A 15 


k+O 5 
P{¥Y =h}= j f(z)dx  (k=0,44, +2,...), 
h-0 5 
whence 
0 herd § es h+0 5 
mn, = >) i \ f{apdx = Yar, = yy i \ f(xjdz~-—m}® 
As=—-o A-0 5 ae ol 


873 The randem vanables ¥ and Y are mutually imdependent 
and have Porsson’s distributions with parameters @ and } Find the 
distribution of their difference 2 = X — Y and of the modulus of them 
difference [f = | X¥ —Y |= [2 

Solution. The randem variable Z may be either positive or negative 
The probability that Z assumes the value & >> 0 18 equal to the sum of 
probabilities that X and Y will assume tuo values differing by 4 (A be 
ing greater than or equal to F} 


~ pri Ti+ sae 
P(Z=kh}= 21 altace 4) (k= 0) 


To 
The probability that Z will assame a negative value —/ 13 


a™ &(™+A} 


PZ=— = 2 ar eel ® 


m= 


For the random vanable U 


—(1T+0) (* _ 0} 





PU== > ay p-(atty, 
m=O 


PU =k}= > ear en (4 > 0) 
m=) 


These probabilities can be writen by means of a modified cylindrical 
Bessel functions of the ist kind 


fy (zt) = 1 (2) = > aitear (z) (k= 0,4,2,.. 7" 
fri 





*) Li the unit of measurements (the value of the division of the ipstrument} 
is smal] as compared to the range of the possible values of the random variable 4, 
then om, a m Var, Var, 

**) Tho tables of cylindrical Bessel functions of the fst kind can he found im 
teference hacks 
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In this case 
P(Z=h}=1,(2V ab) (4) ee (b=0, 41,42, ...), 
P{U =0}=1,(2 V ab) ee), 
PU=h=1,(2Va)[(F) +(F) Jee &>0). 


8.74, Given the joint probability density f (z, y) of the random vari- 
ables (X, Y), find the probability density g (z) of the difference Z = 
— Y, 


Solution. The probability density function of the system (X, —Y) 
is f(t, ~—y) and, therefore, we find from the equation X — Y = 
X + (—Y) that 


g (2) =G' (2)= | f(z, 2—2)de. 


Jf the random variables X and Y are mutually independent, then 


g()= | f(x) fa(e—2)de= | A—2) f(y) ay. 


8.75. Find the probability density of the difference of two independ- 
ent random variables which have an exponential distribution with 
parameters A and pw: Z=X —Y, f, (x) = Ae (x > 0), fF, (y) = 
hey (y > Q). 


Solution, g(z)= | i, (x) f.(e—z) dz; f(x) is nonzero for zx>0: 


8 


— 


f, (x —~z) is nonzero for —z> 0. 








r Ape Az 
(a) 2>0, g(2)= | Aem*tpemHls-2) dz = ‘<r ; 
z 
c Apel? 
—A mu(x—z ei 
(b) <0, g(z)= | Re *wesul<—2) dx = ware 
Consequently 


= { Ape Az (A+-uy-! for z>0, 
| Apetz (At)! = for sz <0. 


The parameters of this distribution are 
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The distribution curve has the form shown in Fig 8 75a For’ = 14 
we get g (z) +o M1 (Fig 8 Tab) This distribution is hnown as a 


Laplace distribution 

876 A contolution of tuo distributions of tuo nonnegative random 
tariables Given two nonnegative random variables A and ¥ with pro 
bability densities f, (z) (z => O) and f, {y} (y => 0) form the convolution 
of their distributions 


Ag {92} 
A 


(a) 





Fig & To 


Solution Assume Z X — 7} we find the probability density g (2) 
of the random vamable Z By the general formula (8 0 9) 


g(z)— | f(a) fez) ds 


Taking into account that f, (2) = O for x < 0 and f, (z — «) — 0 for 
x=>>2 we obtain 


i 


g()— | h@ fee—a)dz (8 78) 


d) 


877 There are two mutually independent random variables A 
and Y which have the same normal distribution with parameters my — 
m, = 0 co, o, Find the probability density of the sum of the:r modult 
4 [X{+ V4 

Solution We designate UV — |A | } — {13 | Their probability 
density functions /, (u} and f, {v) are 


a for ut 0, 
for wsi0 





2 L 
1 ee or (— ae} for vo 0 
| 0 for vO, 


respectively 
Taking formula (8 76} into iccount we get for the convo)ution of the 
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distributions of nonnegative random variables 
g(=\f)f.(2—u)du (2>0) 
0 
or 


Zz 
(= (Se) Gey exp | — (setae — eta) |e. 8-77 


This integral can be expressed in terms of the error function ® (7), for 
which purpose we isolate a perfect square in the exponent of expression 
(8.77). After the requisite transformations we obtain 


2V 2 ai — 2° 
V x (0% 03) oe 2 (0%-+ OF) 


ZOy ZOn 
2 [® ( Gx, VY 024-02, 77 ( Gy V o2-+02 ) |. 
8.78. A number of messages are sent over a radio channel. The length 


of a message X is a random variable which has an exponential distri- 
bution with parameter A (Fig. 8.78). The interval Z between the messages 


g (2) = 


Fig. 8.78 


is arandom variable which has an exponential distribution with para- 
meter ». The lengths of separate messages and of the intervals between 
them are not correlated. Find the probability that no less than m mes- 
Sages will be sent during the time t (m > 1). 

Solution. The total length 7 of m messages plus the intervals between 
them is a random variable which has a generalized Erlang’s distribution 
of order 2m — 1 with parameters 


# 


lig Dey, wwwg Pee “Wg Wy, dare Me 
RRP Pe RE, I go 
m times (m—1) times 


_the probability that no less than m messages will be sent during the 
lime ¢ is none other than the distribution function of the random vari- 


able 7: 
P{no less than m messages during the time t} = P{T < t} = G (1). 


The random variable 7 is the sum of two independent random vari- 


ables: {= 7T, + 7T,, where 7, has Erlang’s distribution of order m 
WHh parameter A: 





17~0575 
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7, has Erlang s distribution of order m— 1 with parameter p° 


m-% 
B's (t} = ee anne (i> ). 





Consequently, for the case A>>p we have 
ox f 


g(t) = { g,(t) g(t —1) dt = je wae CRIP or vtt-n de 
0 





. Gn— 1}! (srt = Zh 


m—2 
—_ eee b pmannt 7g gyi ee ttl 
—~Ta— Tt (m2) 4 m2 Yet 


mm i+sh 
x | 1— >) {wh enh wt | e~Ht = (ft >> 0}. 
A=] 
For the case p>> A we have 


i mi 1 


g(t) = Bs (t— 1) Be (t) dt = a Ch emit (ty! 


m—1+i 
(m+ Fl __ {{p— A) t}% =(pb~Ait _ 
(e— Bye [i SEGRE ertuat] om (> 0) 


=u 


For the case A=p we have 


Ag y2hn—2 
g(t) A i ems (tf > 0). 


879. A pendulum makes free continuous oscillations, the angle » 
(Fig 879) varying with the time ¢ according to the harmonic law 
9 =a sin (at + Oj), where a 1s the amplitude, 
@ 18 the frequency, 0 1s the oscillation phase At 
a moment t= 0, which 1s not related to the 
position of the pendulum, it 1s photographed 
Find the distribution of the angle @ which the 
axis of the pendulum makes with the vertical 
? at the moment of photographing Find the mean 

| —-— value and variance of the angle @ 

Fig 879 Solution © = @ sin @, where the phase © is 
uniformly distributed in the interval (0, 27), 
on that interval the function @ — @sint 3s 

nodnmonotonic The solution of the problem will evidently not change 
if the variable © 13 considered to be uniformly distributed m the interval 
(~-n/2, m/2}, where the function mig monotonic The probability density 
of the angle 1s 





for joj}<4 
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Since the distribution g (p) is symmetric, its mean value mg = 0. 
The variance of the angle @ 


a 
1 (p" dp a 
Var, =— \ SS 
? 1% 2. m2 2 
J Ve—p 


to 





8.80. Given 2 mutually independent random variables 17; 
(i= 1,2,..., 2), each of which is uniformly distributed on the interval 
(0, c), find the distribution of the number Y of the random variables 
(points) 7; falling on the interval (a, b) < (0, c). What is the limiting 
distribution of the random variable Y when n — oo, c — oo and the 
average number of points on the interval (a, 0) remains constant? 

Solution. We introduce a random variable Y;, which is an indicator 
of the event 7; € (a, b): 


As if ; EC (a, b); 


“7 O, if T7;&(a, 0). 
It is evident that 
Y= > Y;. 
i=1 
We designate : satis 





Considering » values T,,..., Zn to be m independent trials, in each 
of which the event 7; € (a, b) may occur. we see that the random variable 


Y has a binomial distribution with parameters nm and p and” mean 
value M[Y] = np: | 


P{Y = k} = Ckp* (1 — p)""*) (k =0,..., 7). 


Let us consider the case when c — co, m > oo, n/c = } = const. 
In this case p +O but the average number of points falling on the 
interval (a, b) is constant: M [Y] = 4 (6 — a) = const. We know (see 
Sec. 4.0) that in this case the limiting distribution of the random vari- 
able Y is a Poisson distribution with parameter d — } (b — a): 


P{Y=h}=Let 


(e054. 2s a2): 

The number of events in a stationary Poisson flow with intensity A, 
alling on the interval (a, 6), has the same distribution. 

us we can make the following conclusion: a stationary flow of 

events with intensity A can be considered to be a limit case of a col- 
eclion of m independent random points on the interval (O, c), each of 
Which has a uniform distribution on that interval, provided that 
n>» 00, € —» oo, but n/c = A = const. We shall need this model of an 
elementary (stationary Poisson) flow later on. 
{je 
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Random Functions 


90 Afunction X (¢) igecalled a random function af its value 1a a random ‘arab 
for any argumont ¢ Examples of random functions V {t} the supply voltage : 
a computer depending on time ? T (hk) the air temperature at a given point; 
a given moment depending on the altitude & above the ground @ {2} the aumh 
of times a computer fails during the time from 0 to t 

The concept of a random function 1a a generalizition of the concept of 4 rando 
vatiable Since we can consider a random variable X to he a function of an elemet 
tary event w (sec Sec 40) X = oo (w) (mo € 2) where QO is a space of elementar 
events or sample space 1% follows that the random function X {/) can be repr 


sented as 
X(NP=— Pt wo} (EQ, LE 7), 


where £13 a nonrandom argument and 7 is the domain of the function X (# 

The realization of a random functron X (t) 18 a specific form it assumes as a fr 
sult of an experiment (when the elementary event «@ has occurred) For example 
registering by am instrument the supply voltage of a computer against time on th 

interyal ( +) we get a realizatio 
oft) v(t) of the random function ¥ ( 

_ (Fig 90 4} 

A number of trials the outcome o 
each of which 1s a random functio 
% () yields a collection of reahzation 
x, (t} xz, (8) z, (t) of this randon 
function Realizations mevitably dite 
from one snother due to random cause 
(Fiz 902) For a fixed moment ¢ th 
random function <A (t} turns into 4 
ordinary random variable This random 
variable ig known a8 a section of a randon 





Fig 901 function 
If we consider several sections as < 
setres of points t; fe #,, rather thar 


one section of a random function we get an m dimensional random vector hic 
describes if in sOMe approximation (Fiz 903) In practical applications if the 
values of a random function are registered with some interval for the values & 
ts t, of the argument then we deal with an » dimensional random vector 

A random function X (t) whose argument is time 1s usually called a stochastw 
crrandem process 1f stochastic process takes place in a physical system 5 then this 
means that the state of the system varies at random with time f If the state of the 
system 5 at a moment ¢ can be desertbed by one scalar random variable X (¢) then 
we deal with a sealar random funetion (a scalar stochastic process) X (t) If the state 
of the system 5 at a moment ¢ 1s described hy several random variables X, {8 
Ny (tf) X, (f) then we deal with a veefor randam funetion V {i} (@ vector 
stochastic process} with & com ponents X,( ¥.(8 Ay (i) 

Stochastic processes are clasaified according to a number of erteria A atochastic 
process taking place in a system J is known as a process with discrete time if the 
transformations of the system § from one state to another are only possible at cer 


tain predetermined moments ¢, f, Fixamples of a process with discrete 
tiie a computer that changes ats states at moments ti of preset by the 
machine cycle time a device tnspected at moments f, fo .« and transferred 


from one category to another as a result 
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A stochastic process with discrete time is also called a random sequence. lf the 
state of the system S is described by one random variable X, then the stochastic 
process is a sequence of random variables: X (t;), X (te), .-., X (én), «++ 

A stochastic process taking place in a system S is known as a process with con- 
tinuous time if the transitions from one state to another can occur at any random 
time moments which continuously fill the ¢axis (or an interval of the ¢-axis). 
Examples of a stochastic process with continuous time: a change in the supply 





Fig. 9.0.2 Fig. 9.0.3 


voltage of a computer V (2) (see Fig. 9.0.1) or a functioning of a device which fails 
and is reconditioned at random time moments. “ 

A stochastic process taking place in a system S is known as a process with discrete 
states if the en of possible states of the system S is finite or countable. An exam- 
ple: a device consisting of two units for which the possible states of the system are 
s,, both units are sound; so, the first unit is faulty and the second unit is sound; 
‘s, the first unit is sound and the second 
Unit is faulty; s,, both units are faulty. 
Another example: transmission of a mes- 
sage Over a radio channel. Here the 
stochastic process X (t) is the number of 
distorted symbols transmitted up to a 
moment ¢. This stochastic process may 
Only have a countable set of states 

» 1, ..., m,...} and “jumps” up by 
unity at the moment a distorted symbol 
is rye (Fig. 9.0.4). 

stochastic process taking place in a 

a system § jis known as a pan with Pies 
continuous states if the set of possible 
States of the system S is uncountable. Example: the process of placing a spaceship 
in a predetermined position about the earth. Another example: the supply voltage 
Y (t) of a computer. 

By the criteria indicated above stochastic processes are classified as follows. 

a. Processes with discrete states and discrete time. 
b. Processes with discrete states and continuous time. 

2a. Processes with continuous states and discrete time. 

=D. Processes with continuous states and continuous time. 
Examples of a process of type 4a. A certain Petrov bought m tickets of a lot- 
ery-loan, which may win or be payed off at certain times (drawings) ¢,. to, ..., 
a stochastic process X (t) is the number of tickets that have won up to and including 
a moment ¢, Another example: the state of the on-line storage of a computer; all 
Possible states of the storage can be indicated and changes in state may only occur 
at discrete moments in accordance with the machine cycle time. 

Example of a process of type 1b. An instrument may be in one of the following 
a states: sy, sound and not switched on; s;, sound and switched on, so, faulty 
hd not switched on, sz, faulty and switched on. We shall encounter many exam- 
bies of a process of type 4b in chapters 10 and 11. 





"69 Applied Prablems tn Probabllity Theory 


Example ofa process of type 2a The values X (4), X {ts} oi a conta 
vous random variable X are observed at moments i, f;, The sequerice of 
values this variable eseumes 13 a procees X (tf) with continuous states and discrete 
time For example if the air temperature 7 19 measured twice a day, then the 
eequence of recorded values of 7 13 a stochastic process with continuous states and 
discrele lime 

Example of a process of type 2b the process } (2) of variation of the supply 
voltage of a computer at any moment £ or of the level of noise in the transrmasion 
of a message 

Let ua consider some of the characteristics of a scalar randem function 4 (t 

A unltariate distribution of a random variable X ff) 1s the drstriuthon of ihe 
section X (2) of that random function for any value of the argument ¢ If the random 
vatiable X (2) 19 coutrayous ther this distribution 1s the probability density func 
tion of the sectron X (i) and 1s deaignated a® f {z ‘} If the random yariable X () 
1s discrete then the wniyarzate distribution of the random function X {i} 15 a2 
ordered series of the probability P {z, 7) that the random variable X {i} assumes 
a value x; at a moment ¢ For a mixed random variable X {2} the utuvariate distri 
bution is apecthed by a distribution function F (zc ft) = P(X ft} <2} Since ads 
tribution funct on is the most general form of a dictribution and rs surtable for any 
random variahle we can use the general notation F (¢ ¢) for a untvariate distri 
bution too 

A bivariate disirtbution of a random function X (¢) 14 @ yolnt distributron of two 
of its sections EX (¢,) and X (é,) for any values of t, and f,{ This rsa function of four 
arguments ry 2%) f ft, We can correspondiagly consider aD n variate distribution 
which 13 dependent on 2n arguments 

A random function X (?) ys said to be normal ii the joint 4istribution of any Dum 
ber n of ite sections taken at arbitrary moments ¢, << ty, << ty <= <i, isan 
a variate norma] distnbution 

The mean value of a random function X (¢) 2s a nonrandom function m, (0) which 


ig the mean valug of the corresponding section of the random function for each 
value of the argument 


my, (2) == M[X (o] (90 1) 


A correlation function (or autocorrelation function) of a random function 4 {#) 
is a nonrandom function of two arguments A, (¢ ¢) which 1s equal to the covar: 


ance of the corresponding sections of the random function for each pair of values 
of the arguments 7 ¢ 


Rett t) = MIX (XE) (9 0 2) 


where X (t) = X (tf) — m, Gi) 19 a cenfred random function 
Fort = ithe correlation function turns into 4 variance of the random function 


R(t t}== Vary (ft) = Var LX Gt = fo, OF (9 0 3} 


The main properties of a correlation fu ition 

(1) Ay ff ft) = AL (  1e the function Fit ¢) does not vary when ¢ i 
replaced by ¢ (symmetry) 

(2) (4, ¢)] So, fl oy (} 


(3) the function Az {# 2) 48 positive definite 1e { { Rett, t} PMH eeix 


(8) (5) 
d¢ af 20 where p(f) 13 any function and (8) ts an} domain of integration 
sfich is the same for both arguments 
For a normal random function the characteristics m, (t) A(t ¢) are exhaus 
tive and define the distribution of any number of sections 
A normed correlation function of a random function X (#) 14 a function 


rx(f t}= a(t ¢ } __Axit tf) (9 14 ) 


Gx (thoxti) 1 Var (t) Vare (£ } 


Ch. 9. Random Functions 263 


i.e. for ¢ == t’ the correlation coefficient r,. (¢, t’) of the sections X (¢) and X (?’) 
is equal to unity. 

A stochastic process X (¢) is known as a process with independent incremenis il, 
for any values of the argument #, << tg << tg <t ... < tg << tpt, <(.... the ran- 
dom values of the increment of the function X (t) 


U,;=X (t2) —X (t), U_= X (is) —X (te), oe; Uy =X (thar) —X (tx) (9.0.5) 


are independent. 

A normal stochastic process with independent increments is known as a Wiener 
process if its expectation is zero and the variance of the increment is proportional 
to the length of the interval on which it is attained: 


m, (t) = 0, Var [U;,] = a (tray — tr), (9.0.6) 


where a > 0 is a constant. 

When a nonrandom term @ (t) is added to a random function X (t), the same 
— term is added to its mean value, but the correlation function does not 
change. 

When a random function X (t) is multiplied by a nonrandom factor 9 (t), its 
mean value is multiplied by the same factor  (¢) and the correlation function is 
multiplied by @ () » (¢’). 

If a random function X (t) is subjected to a certain transformation A;, another 
random function, Y (t) = Az {X (é)}, results. 

A transformation L}° is known as a homogeneous linear transformation if 


Tt 


(1) LO{ S) Xp, (t)} =>) LY {Xz (} 
k=l k=j 


(i.e. the sum can be transformed term-by-term), and if 
(2) LI? {cX (t)} = cL, {X (f)}, 
(i.e. a factor, which is independent of the parameter ¢ with respect to which the 


transformation is carried out, can be put before the transformation sign). 
A transformation L; is called a nonhomogeneous linear transformation if 


Le {X OJP = LAO} +e, 


Where @ (t) is a nonrandom function. 
If a random function Y (é) is related to a random function X (2) by a linear trans- 
Ormation Y (¢) = Ly {X (¢)}, then its mean value m,, (t) results from m (t) upon 
the sa li ron: : . 

me tinear transformation: 


my (t) = Ly {m,, (d}, (9.0.7) 


a find the correlation function R, (t, t’), the function R,. (t, t’) must be twice 
Subjected to the corresponding homogeneous linear transformation, once with re- 
spect to ¢ and once with respect to ?’: 


Ry (tf, UH LOL (Re (t, 3 (9.0.8) 


_ The crosscorrelation junction R.., (t, t’) of two j 
isa tees } xy {t, t) of two random functions X (t) and Y (t) 


Rey (t, t')=M[X (t) ¥ (t’)]. (9.0.9) 
It follows from the definition of a crosscorrelation function that 
Reg lt UTR We 5.0): 
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The normed erosseorretation function of two random functions X (#) and Y {i} 
is a function 


Rey (lf, i} _ fx, (z, i} 


f, t}= SS 90 10 
rey lh, #) Ox Oy(t) — Vary (f) Var, tt) we 
The random functions X ({} and ¥ (é) are uncorrelated uf fi, (2, ’} = 0 
If 2 () = X (t) + ¥ @, then my {f) = mty (2) + my (2), 
Ant (y= Rt ey t Ry, (f, #) + Ayy (t, t) -L- ftgy {t, t’), 
If two random functions ¥ (t) and Y (2) ara uncorrelated, then 
ft, (t, 1) = Ry (t,t) + Ry ft, 2) (9 0 11) 
If 
Tl 
Zith= >) Xp (2), (9.0 12) 
A—-1 
where X, (2), X, (2) + A, (t) are uncorrelated random functions, then 
Tt TI 
tty = & Mx, (),  Ay(t, 7 = 2 ity, {t, £°) 


When transforming random functions 16 1s often convement to write them 
& complex form A compler random variable ts a random function of the form 


Z(t} = X () + iY (9, (9 0 13) 


where X (¢) and ¥ (2) are real Fandom functions and ¢18 a unit Imaginary number, 


e mean value the correlation function and variance of a complez randont 
function are defined thus 


mz (th—= mx (t)timy (2), Ret, t= VX XY, (9.0 14) 
where the bar over the letters denotes a complex conjugate quantity and 
Vatz () = Az (t, 2) = My X ts) |}. (9 0 15) 


Before considering complex random variables and functions {t 15 necessary t¢ 

eine variance ag the mean value of the square of the modulus, and covariance aa 

the mean value of the product of a centred random Varlance by the complex conju- 
gate of another centred ¥arlable*? 


The canonical decomposition of a Tandom variable X {i} ig its representation 
in the form 


TH 
X (t)= my (2) 4 >} Vngy (2)**), (9 0 16) 
k=i 
where ¥, (k= 1, 2 » m) are centred uncorrelated random variables with 
Variances Var, {k = t ay , a) and p, () (A = i, 2, -» mi) are nonrandom 
functions Random varlables V, (k = 1,2, , m) are known as coeffictents 


and functions fr (f) (ek = 41, 2,. +, m) 48 coordinate functions of a canonical de- 
Composition 


a 


*) In what follows we shall indicate the complex natura of a random function 
‘very time, if it 13 not specified, we shall consider a random function to be real 


me In particular, the sum can he extended to an infinite (countable) number 
% terms 
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If the random function X (t) admits of a canonical decomposition (9.0.46) in 
a real form, then the correlation function R, (¢, t’) is expressed by the sum 


Trl 
Rx (é, t')= >) Varn On (t) Pr (t’), (9.0.17) 
k=] 


which is known as a canonical decomposition of a correlation function. 

If a random function X (t) admits of a canonical decomposition (9.0.16) in 
a complex form, then the canonical decomposition of the correlation function has 
the form 


m7 
Ry (t, t')= >) Varg Gp (t) Pr (t’), (9.0.48) 
k=! 


where a bar over the letters denotes a complex conjugate quantity. 

The possibility of a canonical decomposition of a correlation function in the 
form (9.0.17) or (9.0.48) implies a representability of a random function X (t) in 
the canonical form (9.0.16), where the random variables V; (k = 1, 2, ..., m) 
have variances Var, (k = 1, 2, ..., m). 

A linear transformation of a random function X (¢) defined by the canonical 
decomposition (9.0.46) results in a random function Y (¢) = L; {X (é)} also in 
a canonical form, i.e. 


Y (t)=my (t)-+ >) Va vr (2), (9.0.49) 
h=1 
where 
my (t)= Le {mx (t)}, Ya (t)= LY) {Pp (t)}. (9.0.20) 


That is, in a linear transformation of a random function, defined by a canonical decom- 
position, its mean value is subjected to the same linear transformation and the coordinate 
functions are subjected to the corresponding homogeneous linear transformation. 
_ A stationary*) random function X (t) is a random function whose mean value 
is constant, m, == const, and whose correlation function only depends on the differ- 
ence between its arguments: R,, (t, t’) = Ry (t), where t= ?t’ —t. 

From the symmetry of the correlation function R,, (t, ¢’) it follows that R,, (t) = 

x(—t), i.e. the correlation function of a stationary random function is an ever 

junction of the argument Tt. 

The variance of a stationary random function is constant: 


Var, = F,, (¢, t') = R, (0) = const. (9.0.21) 
The correlation function of a stationary random function possesses the property 
| R(t) | < Var... (9.0.22) 

The normed correlation function of a stationary random function is 
p(t) = R, (t)/Var, = R, (t)/Rx (0). (9.0.23) 

The canonical decomposition of a stationary random function is 
X (t)=mz-+ >) (Up cos Opt+V» sin w,2), (9.0.24) 

k=0 


Where Ur, Vp (hk = 0, 4, ...) are centred uncorrelated random variables with 
Pairwise equal variances Var [U,] = Var [V;] = Vary,. 
Cpresentation (9.0.24) is known as the spectral decomposition of a function. 
spectral decomposition of a stationary random function is associated with a series 
ravenna rerne 


*) Stationary in a broad sense. 
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expansion of {ts correlation function: 


Ry (t= )) Vaty C09 wat (9.0 25) 
At) 
wuence 
Varr= » Vatre (9 0) 254 
k=O 


Setting w, = 0 we can rewrite the spectral decomposition (9 0 24) of a sta- 
tionary random function in a complex form, re, 


Aithesmst St wyetPa! 


(3 0 27) 
kos — po 
where 
f.y = — inp Wy a, Wy Waa Shee ad, oe aa } 


The spectral density of a siationaty tandom function X {2} 1s the limit of the 
ratio of the yarance per a gtven interval of frequencies to the length of the interval 
as the jlatter tends to zero The spectral density 3, (w) and the correlation foncvon 
#, {t) are related by Fourrers transformations In the real form this relation Ja 


ct mo 
Sx w= \ Ry(tycoswtdt Ry {t)= j Sx (a) cos wt da (9 0 28) 
0 0 
It follows from the last relation that 
a 
Vata = Re (0) = | $2 (0) dos (9.0 29) 
p 


Ina complex form Fourter s transiormations, which relate the spectral densiiy 
o* (wo) and the correlation function A, (t}, have the form 


{ Lh a) oo 
Stio=so | Reipe tar, Rein= \ stwje™do GOD 


= oo vier ORF 


Appendix 7 1s a table of selationa hetween certain correlation functions aud 
spectral densities 


Both S, (a) and S¥ (w@} are nonnegative real functrong, S# (a) 19 an even func- 


tion defined on the interval (~—oo -+oo) §, () 1s defined on the interval (0, ->°), 
and on this interval St (m} = 055, {0} 


A. normed spectral density s, (w) [or st (w) in a complex form] 1s a spectral den 
€it} divided by the vanance “f the random function X (2) 
s, fa} = Sy (ayVar,, ef fa} = 8% (wl Var, (9 0 34} 


If a crosscorrelatron function Ay , {f, t’) of tno stationary random functions 
X ()and Y (é) 4s a function of only v= ¢' — ¢, then we say that they are station 
ary connected The follows relatuons thao exiat betueen, the ceasscoctelated func- 
tion #,,, (t) and the cross power spéciral density S2, (@), which are defined by tha 
Fourter transformation in a complex form: 


fa i+ 
Sty age | em Rey Gee Rey (= [ol TS%, (a) do (030 
—o 


— oxi 


Ch. 9. Random Functions 267 


If the normal stationary random functions X (é) and Y () are stationary con- 
nected, then the random function Z (t) = X (t) Y (¢) is stationary with character- 
istics 


Mz=MymMy+ Ryy (0), (9.0.33) 
S* (@) = j Sz (@—v) Sy (v) dv+-memy [Sxy (O)S jx (O)] 
a ( Sky (@—v) Six (v) dv--mESY (W) + myS* (O’. (9.0.34) 
In a special case, laa Z(t) = X? (t), we have 
m,=m3.-+ Vary=m.-+ Rx (0), (9.0.35) 
S* (a) =2 ) SX (@—v) S* (v) dv-+ 4m2.S5 (0). (9.0.36) 


White noise (or white noise in a wide sense) is a random function X (), whose 
two different (arbitrarily close) sections are uncorrelated and whose correlation 
function is proportional to the delta-function: 


R.. (t, ') = G () 6 (¢ — #’). (9.0.37) 


The variable G (t) is known as the intensity of white noise. The definitions and 
the properties of the delta-function are given in Appendix 6. 

Stationary white noise is white noise with constant intensity G (4) = G = const. 

The correlation function of stationary white noise has the form 


R,. (t) = G6 (7), (9.0.38) 
Whence it follows that its spectral density is constant and equal to 
S# (@) = G/2n. (9.0.39) 


The variance of stationary white noise Var, = G6 (0), i.e. is infinite. 

If a stationary random function X (¢) arrives at the input of a stationary linear 
System ZL, then, some time later, the time being sufficient for the transition process 
to he damped out, the random function Y (¢) at the output of the linear system will 
7 stationary. The spectral densities of the input and output functions are 
related as 


S* (o) = SE (@) | © (io) [°, (9.0.40) 


Where @ (iw) is the amplitude-frequency characteristic of the linear system. 
The stationary function X (t) is said to possess an ergodic property if its charac- 
teristics [m,, R, (t)] can be defined as the corresponding ¢ averages for one real- 
ization of sufficient length. The sufficient condition for ergodicity of a stationary 
random function (with respect to expectation) is the tending of its correlation func- 
lion to zero as tT—> oo: 
lim R,. (t) = 0. (9.0.41) 
oO 
For the random function X (t) to be ergodic with respect to variance Var,.., it is 
sufficient that therandom function Y (t) = X? (t) should possess a similar (the 
same) property, i.e. lim A, (t) = 0 as tT > o.*) 
T+ 
eaters 


*) For a random function to be ergodic with respect to a correlation function, 


oth necessary that the function Z (t, t) = X (t) X (t+ t) possesses a similar 
er Vy. 
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Hf the realization of a random function ¥ (¢) crosses (upwards) a straight line 
“hich ts parillel to the t axis and 3s at the distance a fromit then the function X¥ (2} 
13 said to eross the level a (see Fig 905 in which the level crossings are marked by 

crosses} The number of 
X(t) A during the time 7 ss a diserete random 


a then the variable can be considered to 
For a normal stationary randomyan 


able Y {t} the averare number of cros 
«ngs of the level a per unit time 1s 





i, . ex (S53) oe. 
Fig 905 a— 5y &XP 202 oy’ 


(9 0 42) 


where o, ts the mean square deviation of the derivative of the random function 
Yig= _ ¥ it (3 0 43) 


The average number of downward crossings of the piven level is the «ame 


Problems and Exercises 


91 Considering a nenrandem function of time p (tf) to be a special 
Kind of rindom function & ({) = @ (t), find 1s mean value m, (2), 
variance Var, (¢) and the correlation function #, (t, t’) Is the random 
function 4 (t) Stationary? 

Answer m, (t) = o (t), Var, (t) = 0, Rit, t} =0 

In the general ease the random function X (t) 1s nonstationary since 
for @ (t) 4 const we have m., {t) == const 

92 The conditions are the same as in the preceding problem but 
this time @ (t) = a = const, where ais a nonrandom variable X (t) = 
a is the random function XY (t} stationary? If xt 1s, then does it possess 
an ergodic property? 

Answer The random function ¥ (f} 1s stationary since m., (t} = @ = 
const, Var, (t) = 0, R,, (f, ¢) = R, (t) = 0, and possesses an ergodic 
property 

93 In each section a random function X (¢) 1s a continuaus random 
variable with a univariate distribution density f (x, t) Write the 
expressions for the mean valne m. (f} and vartance Var, (i) of the 
random variable ¥ (f} 


Answer 
7, (tf) = \ xf{z, tjdz, Var, (t) = \ [2 —m, (t)]* f (x, t} dz 


94 A random function ¥ (#) 38 a random variable Y (f) = VY, where 
V is a continuous random variable with probability density  (v} 
(1) Write the expresston for the univariate distribution (density) 
i tt, 4) of the random function * (é), (2) find the mean value m, {f) and 
varlance Var, (t) of the random function X {t}, (3) write the expression 
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for the bivariate probability distribution function F (a, 2, t,, ts) 

of two sections X (t,), X (t,) of the random function X (tf); (4) find its 

correlation function A, (t, t’)-and the spectral density Sz (). 
Solution. ; 


(2) my(t)= | 2p(a)de=m,, Varg(t)= | (2—m,)* 0 (a) da; 


(3) F (a4, Xo, ty, tg) = P{X (ty) <1, X (tq) Capo P (Vay, Y <a}. 
If z,<z,, then V <2, implies that Vx, and P{(V<xy,V<aj}= 


xt 


@ (zx) dz. Consequently 


am 


p(z)dx=F(z,) for am<2,, 


Caen, 2 Q Cee rea 


| 1 
F (zy, Lo by, te) == 4 
! po(z)dx=F (z,) for 2X, 
x 
Where # (x) = \ @ (x) dx is the distribution function of the variable V; 
(4) R,(t, t’)=M[X (t) X (t’)] = M [VV] = Var,, 
Var, (t) = R,, (t, t’) = Vary. 
Since m,, (t) = const and R, (i, t’) = const, the random function 
X (t) is stationary. Since the ¢ average for each realization is equal to 
the value the random variable V assumes in that realization and differs 


for different realizations, the random function X (t) is not ergodic; 
its spectral density | 


Sx (@) = “re. \ e-iot dm = Var, 5 (0), 
Where 6(w) is the delta-function. We can immediately verify this since 
R,. (t) = \ Sx (a) ett do = \ Var, 6 (w) et dw = Var, eit = Var,. 


9.5. A random function X (é) is given in the form X (t) = Vit + b, 
Where V is a random variable which has a normal distribution with 
Parameters m, and o,; 6 is a nonrandom variable. Find the univariate 
distribution density f (x, ¢) of the section of the random function X (t) 
and its characterictics: m, (t), Var, (t), Rx (t, t’). 
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Auswer. / (x, 1) 15 a normal distribution with parameters m,? + 5, 
nana (mgt +8) 
,t)=— 6 ———sa ee 
Po filo, V ox xpi at Op | 


ri, (ij=m,t+b, Var, (f= 005, Ay (2, t'y= alte’. 
9.6. Show that any function of two arguments of the form 


py Vary Pz (2) p, (2), (9 6) 


where Var, are nonnegative numbers and q, (f) are any real functions 
(i= 1,2,  ,#), possesses all the properties of a correlation function 
Solution It 1s sufficient to show that there 1s a random function X (i) 
which has a correlation function (9 6) Let us consider a real random 
function X (tf) given in the form of a canonical decomposition 


X (t} = m, (t) + 23 Veg, (£), 


where Var LV.) = Var, The correlation function of this random function 
has the form 
y(t t= 2X Varro (t) or (ey, 

and that 1s what we wished to prove 

9 7. Given that the characteristics of a normal stochastic process X {tf} 
are m,(¢} Var, (f}, A, @, tj} and that the stochastic pracess 1s in astate 
z (A (¢} = z) at a moment ¢, find the conditional probability p,g that 
at ay oment => tthe process X (t } will belong to a cerfaim domain 
(a, ) 

Pap = P{X (8°) € (a, BY | X () = x} 


Solution, We designate X (1) = X,, X (t') = X,. Asystem of random 
variables 4,, 4, has a normal distribution f (21, 2,) with characteristics 


My == 9, (2), rte, = mt, (t’), 


Ox, = Var, (2), Ox, = Var, (2°), rg = eth 
Ty Ty, 
The conditional distribution 
mi Od 
f(elah=f(eyasC(esyt, shee filedo | f(y adem 


This distribution 1s also normal with characteristics 


Mx, ixy = Mg Py ao (ey — 1), Oxy tx; = Ox, V 1-7} 2 
Ft 
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Hence 
e} 

] B— | mst ise — (@—m,) | 

sais Be As hy ne 68 on ,: arena 
Pab f (%. | a x) Le 7 V ir, : 
0 
a—| ms + T,2 — (@—my) | 

—D = , 


0... VY ert 2 


where @(z) is the error function. 

9.8. Find the univariate and bivariate distributions and the charac- 
teristics of a random function X (t) defined by its canonical decompo- 
sifion 


X(t)=m,()+ 4 Vai), 


where V; (i = 1, 2, ..., ”) are crossuncorrelated normally distributed 
random variables with characteristics m; = 0, Var;. 

Solution. The univariate distribution f (z,, t) is normal with charac- 
teristics 


Mz, (t)=ms(t), Vare, (t)= 24 Var; gi (t). 


The correlation function 
Re(ty t')=M(DX Vier) 2 Vso; ("= 2 Varig (8) 1 (2’). 
son j= 


The bivariate distribution f (z,, Ze, t, t') is normal with characteris- 
ics mx, (t), my, (t'), Varx, (t), Vara, (t’), Ry (t, t’). The random function 
X (i) is normal and, therefore, the bivariate distribution is an exhaus- 
live characteristic for any number of sections of the function. 

9.9. Given a random function 


X (t) = Vye—%! + Vie-%", 


Where V, and V, are uncorrelated random variables with characteristics 
My, = my, = 0, Var,,, Vary,, find the characteristics of the random 
function (t). 

Solution. The random function X (¢) is given as a canonical decom- 
Position without a free term and, consequently, m, (¢) = 0, 


cee (t, t’) 1 Varo, ea as1(t-+t’) a5 Var», en Gx(t+2"), 
Var. (£) = Vary, e—% #4 -++ Vary, 07%: 2t, 


ae A random function X (é) is defined by its canonical decompo- 
Sition 


1 
xX (Z) = >, V,e77i La, 


era 


i=1 
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where V, are centred random variables with variances Var,, (: = 1, 
2, »ny MIV;, Vs] = Ofori 54), @ is a nonrandom variable 
Find the characteristics of the random function X (#). 

Answer. 


bi # 
m.(t)=a, Ry (t,t!)= 3} Var, e724, 
i=! 
Ft 


Var, (é)= >) Var,,e7 i 
i=! 


9 (1. Arandom function X ()1s defined by a canonical decomposition 
A ft) = f+ VP, cos wt -+- VY, sin wi, 


where V, and V, are uncorrelated random variables with zero mean 
values and variances Var, = Var, = 2 Is the random variable X (} 
Stationary” 

Solution m, (ft) = ¢ R, (t,t) = 2 (cos wtcos of’ + sin wtsin at) = 
2 cos w (t — t } 

The correlation function of the random function X (¢} satisfies the 
condition of stationarity but the mean value m, (¢} depends on trme 
The random function A (¢) 1s nonstationary but the centred random 
function X (zt) 1s stationary 

912 Suppose we have two random functions 


X (t) = V, cos w,t + 1,s1n wt and Y (2) = U, cos o,t + UY, sin ay 


The mean values of all the random variables V,, V., UV, and Uae 


zero, the variances are Var,, = Var,, = 1, Vatu, = Yar,, = he 
normed correlation matrix of the system (V,, V,, U, U,) has the form 
1 0 0.5 0) 
1 0 —0.5 
4 Ol!” 
{ 


Find the crosscorrelation function R,, (, ¢) and the value of the 
function fort =O,t = 1 


solution, 
Ray (ts = MX (2) ¥ (t’)] 

=M{(V,cosa,t+V, sin @,t) (VU, cos ®t 4+U, sin o,¢°)) 

= Cos 0,2 cos @,2'M [V07,] 4+-cos o,f sin @,t'M [VU] 

+ «in w,t cos @,t’M [V,2/,} + sin af sin wat’ M [Voe/s] 

= cos 0, cos wf’ — sin af sin @,f° = Cos (way? + Wt"), 
Roy (0, 1Ij=cosm., Ay, (0, 1) = cos oy, 
Ry, (t, P= KR, @, tf] =cos (at -+ of} 
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9.13. 4 Poisson process. We consider an elementary flow of events 
with intensity 4 on the t-axis (points on the ¢-axis, see Fig. 9.132) and 
arelated function X (£), which is the number of events occurring during 
the time (0, t). At the moment an event occurs the random function 





Fig. 9.13 


X(t) makes a jump, thereby its value increases by unity (Fig. 9.13a)*), 
he random function X (¢) is known as a Poisson process. 

Find the univariate distribution of the Poisson process and its charac- 
teristics m,, (t), Var. (é), R,, (t, t'), Tx (t, t’) as well as the characteristics 
of the stochastic process Z (t) = X (#) — At. 

Solution. The distribution of the section of X (t) is a Poisson dis- 
tribution with parameter a = At and, therefore, the probability that 
the random variable X (é) will assume the value m is expressed by the 
formula Pin = (M)™ (m!)-l em*t (m = 0, 1, 2, ...). The mean value 
and variance of the random function X (¢): my (t) = Var. (t) = AE. 

et us find the correlation function R, (t, t’). Assume that t’ > iz 
and consider the time interval (0, 2’) (see Fig. 9.136). We partition the 
Interval into two portions: from 0 to é and from # to #’. The number of 
Fe 

*) We assume that the function X (t) is continuous on the Ieft, 
(8~0575 
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events over the whole interval (0, ft’) 1s equal to the sum of the numbers 
of events on the intervals (0, t) and (f, ¢)*)* X (é'} = X () + YG —j) 
where Y (t' — t) 15 the number of events which occur m the interval 
(t, t’) Since the flow 1s stationary, the random function Y (f — }) 
has the same distribution as X (f} In addition, according to the prop 
erties of a Poisson flow of events, the random variables X (#) and 
¥ (£ — ft) are uncorrelated 
We have 


R(t, C)= MIX OX CMH MIX OX O+Y @ — ON 
= M (X ()*] = Var, (£) = At. 


Similarly for t>t we get Aft, Uj) = At’ Thus #, (, U}= 
minf{At At} = A minf{é, t’}, where min{?, ¢'} 1s the smaller of the 
values ft, (if £ = ¢ we can take either f or ¢’ as the minimal value) 

Using the notation of a umt function 1 (z) (see Appendix 6) we 
can write the correlation function as 


R(t, t)= Mid —pb+arvig¢—t'). 


Fig 9 13¢ allustrates the surface R,. (t, t’) In the quadrant t > 0 
and ¢ >> 0 the surface R,, (t, t’} consists of two planes which pass through 
the t and ¢#’ axes respectively and intersect along the line 0-Var,, 
the applicates of whose points are equal to the variance War, = At 

The normed correlation function 


re(t f= Ax(t t)} = 24 (1 ~ ty L1t-2) 


V Vars (¢) Vars (6) 


The surface r, (¢ ¢}1s shown in Fig 9 13d 

A Porsson process 18 a process with independent increments since 
its Increment at any tnterval is the number of events occurring on that 
interval, and for an elementary flow the numbers of events falling on 
nonoverlapping intervals are independent 

The process Z(t) = X (t) — At (see Fig 9 13e) results from a non 
homogeneous linear transformation of the stochastic process X (i) 
Consequently m,(t)—m,()—kt=0, Var, () = Var, (t} = Ms, 
fiz, Y= R(t, £) = min (, ¢’} since the corresponding homoge 
neous linear transformation does not change the correlation function 
of the precess X (2) 

914 Astochastic process X (é) occurs as follows There 1s a station- 
ary (elementary) Poisson flow of events with intensity 4 on the ¢ axis 
The random function X (2) alternately assumes values +4 and —1 
Upon the occurrence of an event, it changes its value Jumpwise from 
+1 to —4 or vice versa (Fig 9 14a) Inttially the random function 
X (t)may be either 4-1 with probability 1/2 or —1t with the same prob 





") We neglect the possibility that en event might occur exactly af the moment F 
since the probability of this oceurrente 1s zero 
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ability. Find the characteristics m, (t), Var, (¢) and R, (é, t') of the 
random function X (tf). 

Solution. The section of the random function X (¢) has a distribution 
represented by the ordered series 


—1|+4 


*O=ST05 








Indeed, since the moments of sign changes are not connected with the 
value of the random function, there is no reason for either +4 or —1 
to be more probable. Hence m, (t) = —0.5 +0.5 = 0, Var, (t) = 
(—1)?/2 + 19/2 = 14. 





Fig. 9.14 


To find the correlation function R, (é, t’), we consider two arbitrary 
sections of the random function, X (t) and X (¢’) (t’ > #), and find the 
mean value of their product: 


R,, (t, t') = M [X (t) X (#’)] =M [X (£) X (#’)]. 


The product X (t) X (t’) is equal to —4 if an odd number of events 
(Sign changes) occurred between the points ¢ and ¢’, and to --4 if an 
even number of sign changes (zero inclusive) occurred. The probability 


7 an ry es number of sign changes will occurr during the time t = 
au~ & IS 





= 2 vs —2 
<== > (4) is gmat —_ Qm=At e te ns 
(2m)! 2 : 


Peven 


Similarly, the probability that an odd number of sign changes will occur 
uring the time t is 
AT pAT 
Poaa = 07**§ ————.. 
2 
180 
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Hence 
Hy (é, f} = (+14) Pesen*t (— 1) Poaa = O7""**; 
where t=i'—?f Similarly, for <i 
Rif, ths e72M-0, where r= t'’—?,. 


Combining these formulas, we get A, (2, /)= A, (tye it! The 
graph of this function is shown in Fig 9 14b The surface R,(t,?)= 
e-24]t-?1 1s shown in Fig 9 44c 

The random function A(t} ts stationary Its spectral density 


ah 


; 1 f 
Sz (a) = 3 \ Ry (t)e-Wt drs oe. 


915 There is an elementary (stationary Poisson) flow of events 
with intensity 4 on the f axis A stochastic process X (¢) occurs as fol 
lows when the rth event occurs m 
A(é} Xft) the flow (: = 1,2,  ), it assumes 
a random value V, and retatms that 
value till the next event occurs 10 
the flow (Fig 915) At the mutual 
moment xX (0}= YV, The random 

variables V,, ¥,,; Ve, , Vi; 
are independent and have the same 
distribution with density g (2) Find 
Lt the characteristics of the process, 
Tig 915 viz mz, (t), Var, {t), R (t, ¢) 13 

the process stationary? 
Solution Any section of the random function X (2) has a distribution 
g (z), hence 





ms(t}=M[Vil= | 29 (2)dr= me, 


Var, (t)= Var, = { (x—m,)* 9 (2) da 
We find the correlation function R,, (t, 2") by the same technique we 
used in Problem 914 Let us consider two sections X {t) and X (¢) 
({ = t) divided by the interval t = 7! — ¢t We have 
R(t, {)=M{X () X(¢’)). 
If no events occurred between the points ¢ and 2’, then X(t) =X (t) 
and ft, (t, ’) = M [{X (2))?] = Var, (f)—= Var, Jf at least one event 
occurred hetweer the points ¢ and ?’, then M LX (t) X (t')} =0 Hence 
R, (i, t") == o< AT Var, +-[t—ernAt] O= Var, g—At, 
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Similarly, for t’<c% we have 
R,, (é, t') = Var, e~*-%, 


whence it can be seen that the process is stationary. Its correlation 
function R,.(t) = Var, e~*Itl does not depend on the form of dis- 
tribution @ (z) and only depends on its variance Vary. 

9.16. A process with independent sections. We consider the stochastic 
process X (£), described in the preceding problem, in the limiting case 
when the intensity A of the flow of events tends to infinity. Investigate 
the behaviour of the characteristics of the process as 4 —> oo. 


Ro (T ) 
Var, 





0 
(5) 
Fig. 9.16 


Solution. When A increases, the correlation function R, (t) = 
Var, e~4Itl converges to the origin (Fig. 9.162). In the limit we get 
a correlation function of the form 


R,. (t)== lim R,.(t) = lim Var, e~*!t! = Var, lim e~4!t), 
A> 00 A> 00 


A> 00 


i.e. a function which is equal to zero everywhere except for t = 0, 
and equal to Var, for t = O (Fig. 9.160). We can write this as 
Var, for t=O, 


Miglth = | 0 for +t=<0. 


Since by the hypothesis of Problem 9.15 all the sections of the sto- 
chastic process X (¢) are independent, we have obtained a model of a 
Stochastic process for which any two arbitrarily close sections are in- 
dependent. We can call this “a process with independent sections”. 
slochastic process with independent sections X (t) we have in the 
Imiling case when A —> co does not possess any points of discontinuity. 

9.17. White noise. Let us consider a limiting case for the stochastic 
Process X (i), presented in Problem 9.15, under the condition that 
the intensity of the flow A tends to infinity and at the same time the 
Variance Var, of each section tends to infinity with Var,/A = c = const. 
Find the characteristics of this resulting stochastic process Z (¢) and 
show that the random function Z (4) is stationary white noise. 
Solution. We investigated the behaviour of the stochastic process 
\ (!) as A > co in Problem 9.16; we shall now take into account the 
additional conditions Var, — oo, Var,/A = c. Let us consider the 
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spectral density 5, (@) for the stochastic process X {t) of Problem 9 45 


Var A Var 2 
S2(0) =" aapat = Gh Wepar 


From the condition Var,/A=e¢ we have Var, /(mA) = c/n = a2 =const 
The correlation function R,(t}=amhe Altt 

For the stechastic process Z(t) which results ag 4—» co Vary — 00 
Var,/A=e we get 





ft, (?}= lim 2, ()) = lim anjenAltt as an lim je-sttl and (7) 
+o A-FO0 


AD 


where §(t) 1s the delta function (see Appendix 6) 





S, (®} = jim 


Ae Oo 


at 
Mar 4 

We have thus verified that the stochastic pracess 4 ft) 1s stationary 
White notse and constructed a model for tts appearance White noise 
can be regarded as a limiting case of a Sequence of short independent 
similarly distributed pulses with large variance In practice we en 
counter these processes when we consider natural interferance such as 
thermal noise in electronte devices shot effect, and so on 

318 We consider the stochastic process X (f} described in Problem 
915 under the condition that the distribution of each random variable 
Y;@=0141 2 ) 18 normal with mean value m, = O and variance 
Var, Find the characteristics m, (t} Var, (t) and R,, {t t) of the 
Stochastic process X (t} Is the process stationary? Is 1t normal? 

Solution Any section of the random function X (t}) 1s normally dis 


trrbuted with parameters th, Op, = Y Var, It follows from the solution 
of Problem 915 that the correlation function #, (x) — Var, e At 
Ihe process 1s stationary But ts it normal? No it is not despite the 
fact that the univariate distribution is normal The joint distribution 
cf two sections of the Stochastic process X (t) is no longer normal since 
the sections coincide with nonzero probability which cannot be the 
case Uf two random variables have a joint normal distribution 

913 A model of a flux of electrons in a radio valve A flux of electrons 
directed from the cathode to the anode of a radio valve is an elementary 
flow with intensity 2 When an electron is ahserbed by the anode the 
voltage of the latter increases Jumpvise by unity and then begins to 
decrease exponentially with parameter a which depends on the charac 
tertstics of the electronic circnit (Fig 9192} The increment of the 
voltage which ts due to the arrival of an electron 1s summed up with 
the residual anode voltage Find the characteristics of the stochastic 
process X (ft) 1e the anode voltage 

Solution Electrons arrive at the anode at random moments 
I, T, Qi which form an elementary flow of events The 
voltage at mament tf which js due to the action of the ith electron 
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arriving at the moment 7’;, is 


0) for E<T;, 
W; =| Q et- Tp) for tT; 


where 1 (#) is a unit function; T; > 0, ¢ > 0. Let us consider a ran- 
dom variable Y, which is the number of electrons arriving at the 
anode at time t. This variable has a Poisson distribution with 


— | (t — T;) pos. 


X(#) 





Fig. 9.19 


parameter At. We represent the voltage X (¢) as the sum of a random 
number of random terms: 


Y 
KGS) 6 1 a). (9.19.4) 
i= 


We have shown somewhat earlier (see Problem 8.80) that a Poisson 
llow of events on the interval (0, t) can be represented, with sufficient 
accuracy, as a collection of points on that interval, the coordinate of 
each of which ©; € (0, ¢) is uniformly distributed on that interval (see 
Fig. 9.149) and does not depend on the coordinates of the other points. 
Consequently, expression (9.49.1) can be rewrilten in the form 


Y 
X (t= 2 oP, (9.19.2) 


i==1 


Where the random variables ©, are independent and uniformly distrib- 
uled in the interval (0, ¢). 


We designate X, (t) =e7 7° °:) = e- tei, and then 


Y Y 
X (t)= py X; (t) =e" 2 e771, (9.19.3) 


Where X, (2) are independent similarly distributed random variables, 
and the random variable Y does not depend on the random variables 
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X, (t) either In accordance with the solution of Problem 7 64 we wr te 
the expressions far m, {i} and Var, (4 


My (t) = my (2) my, (£} (9 194} 
Var, (f} = my (#) Var,, (t} + Vary () mz, (2) (9 19 5) 


Since the random variable + has a Poisson distribution with para 
meter At it follows that m, (#} = Var, (f} = At Let us find m,, (4) 


t 
me ()=M[Xi(H]=z fe wt dr 
0 


‘Next we determine the <econd moment about the orngin ef the random 
variable Y;, (t) 


{op of 
ai 


f oat 
MX? (t)]=— fe att =P de 
Consequently 
m,(t)—? 228 = (9 19 6) 


ce 
Var, (1) = At}Vare (t) + ms, (t)} — MM AX? (8) — yin (9 49 7} 


Note that asf — vo the mean value and varrance of the process X (f} 
do not depend on time hm m, (ft) = m, —A/a lim Var, (f) — 
f+ oo 


too 
Var, = d/(2a) 

To find the distribution of the section of the stochastic process X (f) 
for m, — Ala t> 20 we reason as follows Considering a finite but 
sufficiently large interval (0 ¢) and assuming that a sufficiently large 
number FY of electron emissions take place on that interval we see 
that the process X (t) [see formula (9 19 2)] 1s a sum of independent 
similarly distributed random varrables which has an approximately 
normal distribution since m this case the conditions of the central limit 
theorem are in fact fulfilled (see Chapter 8} Consequently the section 
of the stochastic process has a normal distributron with characteristics 
my, = Af and Var, = {2a} The precess will practically become 
stationary in the time 1,4, = 3/e 

To tind the correlation functions let us consrder two sections of the 
stochastic process in question at moments ¢ and t (t =» t} By virtue 
af the assumptions made we can assert that the anode voltage A (tf) 
of the valve at the moment? 1s equal to the voltage X (#) at the moment 
¢ multiphed by the exponent e &(t 1 plus the voltage ¥ (¢ — # 
which results from the arrival of electrons at the anode in the time 
interval {i f ) 


X({)—-X (set OL V(t —8) (9 19 3) 
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The stochastic processes X (¢) and Y (t = t) are evidently independent 
since they are generated by electrons arriving at the anode during 
different, nonoverlapping time intervals (0, ¢) and (¢, 2’) respectively. 


The same can be said of centred stochastic processes X (t) and Y (t' — ft). 
Consequently, 


R,, (t, t’) = M [X (t) (X(t) eat’ 4 Y (2 —2)}] 
= M ((X (t))2Je"%4-O for >t, 


R, (t, ’)=MU(X(t’))2Je-et-t)— for tt’. 
Combining the last two expressions, we obtain 
R,, (t, t’) = Var,, (min (é, #’)) (1 —e2e min, 1] e-ale— ey, 


Let us consider the limiting behaviour of the stochastic process when 
t—> oo, t’ -» oo, but the value of their difference t = ¢’ — ¢is finite. 
In this case 


R,, (1) = Var, e-2It1 = eal, 


Thus the stochastic process X (t) we consider in this problem is 
stationary and practically normal for ¢ tending to infinity and A/a > 20. 

This problem is a moré general case of Problem 9.13. Indeed, as 
a@ —-Q, the anode voltage of the valve is a Poisson process since with 
the arrival of each new electron the voltage only increases by unity 
and does not decrease with time. Consequently, the following equalities 
must hold for any finite ¢ and ?¢’: 


2Z2at 


{—e ae. 


-at 
lj ——- ' oe = — 1 \ — im 
a m, (t) = lim A Z pe ary (¢) = lim A 20 


a> 0 a> 


lim R, (t, t’) = lim A (4 —e-2emin(t, 1)] gal t’-t! — 4, min (t, 2’). 
a0 ae 20 


The reader is invited to verify their validity. 

9.20. The functioning of a linear detector. Under the conditions of 
Problem 9.19, we assume that electrons arrive at the anode in “bursts”, 
the moments of arrival of the bursts forming an elementary flow with 
intensity 4. The number of electrons in the ith burst is a random variable 
W; which is independent of the number of electrons in the other bursts 
and has a distribution F (w) with characteristics m,,, Var,,- This prob- 
fm is equivalent to that of defining the output voltage of a linear 
detector, when positive pulses of the random variable (of the highest 
Voltage) IV’; arrive at its input at random moments defined by the Pois- 
Son flow, and in the intervals between the pulses the voltage drops 
‘xponentially (Fig. 9.20). Find the characteristics of the process. 
olution. We can represent this process by a formula analogous to 


(9.19.2) 


. 
X (t)= Db Wye, (9.20) 


—— 
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where the random variables Y, IW, 60; are mutually independent 
We designate X, (t)==W e7™'"°), and then 


_ pt at at 2at 
MEX, (1)] = mw -S—, MIX4(t)] = (Vatu m3) 40 
Consequently, 
__ 97 2at 


{--e~ 2, 1 
nm. (t}= Am, —a «Vary (t) = 4. (Var, + mi) 


2n 
As t-»oco, we have 


Aun 
kh 





lim my (t) =m, = , im Var, (¢) = Var_ = a (erat Pee trib) 
f -. oo {os 


A, {t} = Var,e-fitt 


Let us consider the limiting behaviour of the process X (¢) when the 

following quantities increase indefinitely the intensity of the Poisson 

flow generating the pulses 

X(é) (§ —- oo), the variance of the 

We amplitude of each pulse 

We W, WA : (Var,, co) and the param 

é J eter « (@-~» oc) An infinite 

I increase of the quantity a2 

4 ! | signifies that the pulse vo tage 

drops rapidly, 1e inthe limit, 

Yl Gy fe IZ ne ae &% > oo, the area of the 

pulse tends to zero, the speeds 

at which the quantities 4 and 

Var, increase being propor 

tional to the speed of increase of the quantity a A=fA,e, Vary = 
ke, We obtain (as ¢ —> 00) 


Tig 920 


A 


A h+o0  a-+oo 
? 4 
lim Var, = lim A(Varw tm) oO, 
4 @ Var jm h,a Var, +00 ac 
lim A — ity ky _ 
x(T}= lam 2 ae Itt = Kk 8 (1), 


where § (t} as the delta functzon 

Thus, in the limit we have white noise, which results from an infintte- 
ly frequent series of pulses which have a finite expectation of the am 
plitude of a pulse and an irfinite variance of that amplitude, as well 
as an infinitesimal duration of the pulse itself 

9 21. The shot effect Let us consider a stochastic process X (tf) gener- 
ated by a Poisson process like the case in Problem 913 As the sth 
event of the Poisson flow occurs at a moment T;, a nonnegative voltage 
pulse W, arises in the electric errcurt, whose random value (amplitude) 
then varies according to one and the same law ¢ (y}, where the variable 
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1 is reckoned from the moment 7; (Fig. 9.21) (p (0) > @ (m)). The ran- 
dom variables W; are mutually independent and have the same dis- 
tribution function F (w). The voltage in the circuit is the total eifect 
of all the pulses with due regard for their variation in time. 

The stochastic process being considered is known as the shot effect 
(shot noise). The stochastic processes investigated in problems 9.19 
and 9.20 are special cases of the shot effect. We must find the charac- 
teristics of shot noise. 

Solution. In accordance with the solu- (7) 
tion of Problem 9.20 shot noise on the , 
interval (0, t) can be represented, as in 
(9.20), in the form 


Y 
X()= 4 Wip(t—9;), (9-24) 


where Y, W;, 0; are mutually indepen- Fig. 9.21 
dent random variables, and, by analogy 
with Problem 9.20, the random variable Y has a Poisson distribution 
with parameter Ai and the random variable ©; is uniformly distrib- 
uted in the interval (0, 2). 
We designate X; (t) = W,9 (t{—9;) and then M[X;, (4)] =m,t'0 (2), 
f 


where m,»=M(W;], ®(t)= \ p(é—z) dz is the area of a pulse (the 


0 
area bounded by the curve @(ny) and the coordinate axes): 


M [X3 (t)] = (Varw -+ m2) 10 (2), 
i d 
where Vary = Var[Wi]= | (w—my)?dF (w), B(t)= | — (ta) Pde. 
0 0 
Consequently, m,,(t) = Amy, (¢), Var, (t) =A (Vary + m?,) ® (2). When 
{> oo and there exist improper integrals, 


OO OO 


Lim ® (t) = | o(t—2)dre=®, lim&(t)= | gt -2)de=G 
00 . t-00 a 


0 0 
my, = hm,@D, Var, = (Vary + m3) @ 


In practice these improper integrals always exist since the area of 
a pulse with an initial unit amplitude and the area defined by the 


‘Square of the respective function are finite quantities in practical ap- 
plications. 


_ Reasoning as we did when deriving formula (9.19.8), we obtain 
A(‘Y=KX Oot’ —t)+¥t' —?t) fort >t. Consequently 
Var,, (i i’ —t f : 
Rel t)={ ye ane ; oo 
Var. (t’)p(t—2t') for t>t'. 


3 
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Combining these two expressions, we find that 
R, ti, fy = Var, (min (f, 2"}} Y (j { — t |}. 


As t, t +oo, we get #, (t) = Var, ({t |} {t= — 7} Thus 
mc See that ast ft’ —» oo, the noise effect is a stabionary stochastic 
process 

Let us consider the limiting case when the intensity A of a flow of 
pulses tends to infinity, the variance Var,, of the pulse also increases 
indefinitely, and the area of a pulse with unit amplitude @ tends to 


zero, so that the variable @ also tends to zero Then the following con~ 
ditions are fulfilled 


lim 49D = m2, hm A(Var,-+ mi) P= Var- 
A-* on i, Var +o 
D+ 0 Df 


In that case shot noise turns into white noise with characteristics 
m, =m, &, (t) = Var 6 (+), where § (1) 1s the delta function 

922 Impulse notse Consider shot noise generated by rectangular 
pulses The amplitude IV, and the duration x, of a pulse arriving at 
the moment 7, are independent random vartables with characteristics 
m, Var,, m, and Var, respectively (Fig 922) Find the mean value 
and variance of this stochastic process X {i} 

Solution. The impulse noise considered on 
the interval (0, ¢) can be represented as 

Y ¥ 


X(t)= Dy Wiolt, Op 2) = Dh X; (t); 


{= 


Ws; 


i where @ (f, O;, %,) 18 a pulse which begins ab 


Fig 922 the moment @,; and whose herght 1s unity an 
duration 1s x, (the random variables Q, and x; 
are mdependent) g(t O,, x) = 1 (i — O,)1 (0; + x: — 2 The 
random variable ©; 1s umformly distributed within the mterval (0, 2) 
Letus find M [ep (f,0,,%,)} We advance a hypothesis that the random 
variable x; assumes the value x If this hypothesis 1s satisfied, we find 
the conditional] expectation for sufficrently large values of ¢ 


i 
Ki, [p (t, O,, *)] = f(t —y) (y+ u—i} dye 


The integrand 1s a rectangular pulse with unit height and duratzon X, 
and the integral of that function 1s equal to the area of the pulse Con 
sequently, 

M, Ig (é, O1, x)] = x/t, 


whence 
Al lp (i, ., x;)] == Kf [sez /th = Ty t 
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Similarly 
M9 (t, 1, m)I=—> | A (t—y) tyt+x—HPdy ==, 
0 
M [9 (é, ©:, %)?] = . 
Consequently 


M{X, (| =M [W,9 (¢, 03, %:)] = mpm, /t, 
M (X3 (t)] = M [(Wig (t, O14, %3))?] = (Varw + my) m,/t, 
M[X (‘)] =m,=M[Y]M[X;(t)]=Mmym,/t =Am,m,, (9-224) 
Var [X (t)] = Var, = M [Y] M [Xj (t)] = A (Var, + mi) m,. 
(9.22.2) 


In the limit, when the intensity of an elementary flow and the vari- 
ance of the amplitude of the pulse Var,, increase indefinitely, and the 
mean value m, and the variance Var, of the duration of the pulse 
decrease indefinitely, while the quantity Var, = A (Var,, + mi) m, 
remains constant, the impulse noise turns 
into white noise with characteristics m.,., 
R(t) = Var, § (t). 

9.23. Change in the quantity of homogeneous 
elements. Consider a process X (t), i.e. the 
number of homogeneous elements functioning 
at amoment ¢. We assume that each element 
functions for a certain random time x, which 
has an exponential distribution with param- 
eler p, similar for all the elements, and 
then fails (“decays”). The beginning of the 
functioning (beginning of “life time”) of each element is accidental 
and is defined by an elementary flow with intensity 4. For example, 
X (t) is ihe number of computers used, the intensity 4 is the number of 
computers produced per unit time, « is the random life time of a com- 
puter (the average time a computer operates is 1/1). Find the charac- 
teristics of the stochastic process X (t). 

Solution. The stochastic process X (¢) is an impulse noise like the 
One considered in the preceding problem, the only difference being 
that 17; = 4 for any values of i (m,, = 1, Var,, = 0), and the random 
Variable % has an exponential distribution with parameter uw. Con- 
sequently, for sufficiently large ¢ [see formulas (9.22.1), (9.22.2)] 
MIX (t)] = Am,,m,, = d/p; Var [X (#)] = 4 (Var, + m3) m, = Aw. 

We can prove that the univariate distribution of the stochastic 
process X (¢) is a Poisson distribution with the characteristics obtained. 

When seeking the correlation function of the stochastic process X (t) 

cing considered, we can use a property of the random variable x, 
Which is the duration of the pulse and has an exponential distribution. 


The property is that the “remainder” of the pulse duration x (Fig. 9.23) 





Fig. 9.23 
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reckoned not from its beginning f but from a certain moment }, 
(T <. t, << T + x) also has an exponential distribution with parameter 
uw (see problem 5 35) 

We advance a hypothesis that the stochastic process X {t} =n 
(zn = 0, 1, 2, ) We designate the probability that the hypothesis 
i true as P, (ft) = P(¥ (4) = nm) Assuming that the hypothesis 3s 
true, we can write an expression for the random function X, (t) 
(i => 2) 


X,, (y= VitYt'—t), 
where V, is a random variable which has an ordered series 


0 { 


V3 
{amg mit ~2) | g(t 8) 


(x = 0), 

V,= 0, ¥ ( —t) 1s a stochastic process generated by the events 
occurring in the Poisson flow in the time interval (t, f') The variable 
TI 


2 Vs is the number of elements remainimg at the moment f’ if they 


Were 2 In Humber at the moment ¢ 
Let us find the conditional expectation of the product X (tf) A (¢) 
provided that ¥ (f) = pr 


Ti 
M [nX,, (t)] = 2M [X, (t')] == nM (2 Vit¥ t—t’y 
4 
= n{newPtt - 4 MYLY (2— £))} x nte wht -2 + nam, 
where my = 1/p Consequently the unconditional expectation of the 
product X (2) X(t’) 19 
M [X (t) X (t’)] = 2 M [2X (t’)) P,, (t) 


= 2s nie- HOOP, (t) + » nhin,Py (2) 
t= n=0 
= M[X? (f)} e-# G-) 4 
Hence 
fy (f,@) Varyet*#G@-0 for >t 
or 
Ry{t, t= Varewee-t) for tot’ 
Combining these two formulas, we get (r— t’ — #} 


R,, (1) = Var e-# It) = = e-nit) 
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For A/u >> 20 the process of accumulation of homogeneous elements 
can be considered to be practically normal with characteristics m, = 
Afw and Ry (t) = Apte-Hitt, . 

9,24. One-dimensional random walk of a particle. Let us consider, on 
the z-axis, a particle which changes its position jumpwise (walks) due 
to random collisions with other particles (Fig. 9.24a). At the initial 
moment the particle is at the origin, at the moment 7, of the first 





Fig. 9.24 


collision it jumps into a point X,, at the moment 7, of the second 
collision it jumps and changes its abscissa by the value X., at the 
moment J’; it changes its abscissa by the value X, and so on. The 
random variables X,, Xo,..., X;,... are independent and have the 
Same distribution with m, =O and Var,.==: Var. The moment 
fi, T,,..., Tj, ... at which collisions occur form an elementary 
llow of events with intensity A. 

We consider a stochastic process X (t), the abscissa of a point walking 
at random as a function of time (Fig. 9.24b). (The values of X (t) may 
be both positive and negative.) The process X (t) is a Simplified model 
of the Brownian movement of a particle. Find the characteristics of 
the stochastic process X (2). 

Solution. The number of events on the interval (O, ¢) is a random 
Variable Y which has a Poisson distribution with parameter At. The. 
value of une process X (t) at the moment ¢ is defined by the formula 


X(t) = >! X;, ie. is the sum of a random number of random terms; 
i=t 


in this ere all the random variables X; and! Y are independent. As. 
m Problem 9.20 we have m,, (t) = M{[Y] M[X,] = 0, since M[Y] = 
At, M[X;] =m, = 0, 


Var, ()=M [Y] Var [X;]-+Var [Y] M[X,]?=At Varfsince Var [X ]=Var,. 


By analogy with the solution of Problem 9.20, for a sufficiently large t 
the section of the random function X (f) has a’ practically normal dis- 
‘ribution with the parameters obtained. 
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We seck the correlation function of the process A (f}, for which 
purpose we consider two sections X (#}) and X (f°) (t' => #) It ts evident 
that X (i!) = X (f} + Y (f/ — 2} Here, as in Problem 9 20, the sto- 


z 
chastic process Y (t’—t)= >} X,, where Z is the number of events 
t=1 


occurring in the flow on the time interval ?’—?t. We have indicated 
that the stechistic processes X(t), X(t} and Y(t—t’) have a zem 
expectation Consequently, for ? >t we have 
RG ty — MEX AX CY MX VIX (H+ Y ( —o} 
= MX? (4) + MX (2) ¥Y (t' —2] 
= Var, (f)-+ M [AX (t)} M LY (é’ —t}] = Var, (£). 
For ¢ <(twe get AY (t,t }= Var, (t'} Thus 
A(t, ’}= Var A min (¢ 2) 
The stochastic process X(i} we have considered is a process with 
independent increments 


Remark A one dimensional random walk of a particle has the same charat- 
teristics ag the process Y (ft) = X (¢) -~ At, where X (¢) 13 a Poisson process despite 


aoe that their reilizations differ considerably (compare Fig 9 13¢ and Fig 


9.25, The Wiener process We consider the lumiting behaviour of a 
random process X (t), which 18 a one dimensional random walk of a 
particle (see Problem 9 24) for an infimite increase in the intensity 4 
of the flow of collisions and simultaneous infintte decrease 1n the +arl- 
ance Var of the displacement of the particle, in that case the condition 
A Var = @ = const 1s satisfied Show that in this hmuting case we 
have a Wiener process for time intervals sufficiently distant from the 
origin 

Solution. The condition m, (2) = 0 follows from the hypothesis of 
the preceding problem We have also shown there that the increments 
are tndependent and the process is normal as t — oo. 


Var (X (t,) — X (ts)] = M[(X (t,) — X (t.))*] since my, = 0, 
M U(X (4) — X (¢_))*) = MIX? (t,) + X* (t,) ~ 2X (t,) X (4) 
= Var [X (t,}} + Var 1X (t,)] — 22x (tr 4) 


It was shown in the preceding problem that Var {A (f)]= 4 Var I, 
Hi, (ty, f:) = % Var min{é,, #,) Hence for t, > ty 


Var [X (£,)—X (t2}] =A Vert, +4 Var t,— 2h Var min {t;, ¢3} 
=AVarit,-h Var t,—2 4 Var ty =) (to— by), 


whence it follows that we have a Wiener process 
7.26. A random function X (2) is constructed as follows 
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At the point ¢ = 0 il assumes at random one of the values +4 or —1 
with equal probability 1/2 and remains constant until t = 1. At the 
point t = 4 it again assumes one of the values +1 or —1 with the same 
probability 1/2 and independently of the value it has assumed on the 
preceding interval. This value is retained until the next integral-valued 
point f = 2, and so on. In general, the function X (¢) is constant on 
any interval from m to nm + 1, where 7 is a natural number, and as- 
sumes one of the values -+-1 or —1 with probability 1/2 on the boundary 
of each new interval independently of the preceding values (one of the 


X(é) b(t) 


A 





Fig. 9.26 


possible realizations of the random function X (t) is shown in Fig. 9.26a). 
Find the characteristics of the random function X (t), viz. the mean 
value, the variance and the correlation function. Determine whether 
the random function X (t) is stationary. 

Solution. 


4 4 
M-. (t) =m, =(— 1) > t+1=z=09, 
Vary (t) = Vary =(— 1)? 4-427 =1. 


We find the correlation function R,, (t, t’). If the points t and t’ 
belong to the same interval (2, n + 1), where nv is an integer, then 
R(t, t') = Var. = 1, otherwise R. (t, t’) = 0. We can write this 
result in a more concise form if we denote the fractional part of the 
number ¢ by b (t) (see Fig. 9.26a). Then we get (t = t’ — f) 


ia 2 -{' for [t{ <1 1—d (min {é. ¢’}), 
O10 for |r| > 1—b (min {t, #)), where t=2'—#, 


_ This function depends not only on t = t’ — t but also on where the 
interval (¢, ¢’) is on the ¢-axis; consequently, the random function X (t) 
iS nonstationary. 

The surface R,. (t, t') looks like a number of cubes with the edge equal 
lo unity which are placed on the @, f’-plane along the bisector of the 
Fig 260)" tf = t’ so that the base diagonals coincide with the bisector 
; 9.27. Arandom function XY (t) is formed in the same way as in Prob- 
em 9.26, the only difference being that the points at which the func- 
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tion assumes new values are not fixed on the? 1.18 but occupy random 
positions on if retaining a constint distance equal to unity between them 
{Fig 9 27a) All the positions of the reference point relative to the 
sequence of the moments when the function assumes new values are 
equiprobable Find the characteristics of the random function X {f) 
viz the mean value variance and correlation function and determine 
whether the random function X (¢) 1s stationary 

Solution As in the preceding problem m, (t) = m, =O Var, (t} — 
Var, — 1 

Let us find the correlation function Vee fix & moment f (Fig, 9 27a} 
This moment is random relative to the points at which the random 


Ro {Tt} 


i L 





r 
(4) 


lig 927 


function A (#) assumes new values We designate as 7 the time interval 
which separates the paint ¢ from the nearest point at which a new value 
of X (¢) wtll be assumed The random variable J 1s uniformly dis- 
tributed on the mtervil from 0 to 1 Assume? >t tat — i>0 
lft << 7 then R, (¢ t) —dandiftm Pf then R, (¢ ¢) =O There 
fore for O<c t<c 1 we have 


Aye(@@ t) =P (Pot) 1+P <t) O=P(T > th}=1-7 
Simtlarly, fort <2 0 we htve 
fi,(@@ tj)=141 for ~—i<1r<c0 
Hence 
{— ft] for [t]/ <1 
Ry (t ty Re()—}p " for |t{>1 


The graph of this function ts shown in Fig 9 278 Since A, (t #} = 
R(t) the random function X (f) 1s stationar} 

We cin write the correlation function (9 27) in a more concase form 
with the aid of the unit function 1 f(z) 


R= HA —-—[rHtad— fry 

928 The conditions of Problem 9 27 are changed so that at each 
Tandom moment 7; divided by unit intervals the random function 
A {é) assumes (independently of the other functions} the value Ef, 
which is a randem vartable with mean value m,, and variance ‘ara 
and retains that value till the next point One of the realizations of 
this random function 1s shown in Fig 9 28 Find the characteristics of 
this random function viz the mean value the variance and the corre 


(9 27) 
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lation function. Determine whether the random function is station- 
ary, and if it is, then find its spectral density. 
Solution. Reasoning as in the preceding problem, we find 


m,, (t)=M [X (4)]}=m,, Var, (¢) = Var [X (¢)] = Var,, 


Var, (i—|[t]) for |t]<1 | 
0 for |t|>>1 = Var, ({1—|t|) 1 (1— |t})- 


The random function X (¢) is stationary. Its spectral density Sz (o) = 
Var, (1 — cos w)/(mw*). 

9.29. A random function X (t) is an alternating step function 
(Fig. 9.29a) which assumes values +4 and —1 alternately at unit 
intervals. The position of the step 
function with respect to the reference 
point is accidental; the random vari- 
able 7, characterizing a displacement 
about the origin of the first point of 
the sign change, is a random variable 
uniformly distributed in the interval 
(0, 1). Find the characteristics of the Fis. 9.28 
random function X (z): the mean value, oe 
variance and correlation function. 

Solution. Let us consider the section of the random function X (t); 
lt may fall, with equal probability, on the interval on which the random 


X(t) 


R;, (t) = 








Fig. 9.29 


lunction Is equal to +4 or on the interval on which it is —1, Con- 
sequently, the ordered series of any section has the form 


—t | +4 |. 
1 
2 


X (2): 
2, 
Whence M==—1 a 4 x5 == Oand Var, = (—1)? x +(1)2 X=. 


12* 
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Let us find the correlation function (t =i ~f € > 2) 


R(t t} MIA OA C+ Y= MIAWMXK ETS 


Since the product X (f) A (f + 1) can assume only two values (+1 or 
—1) it fellows thit MIA @) A (¢ + t)] = tp, + (-—D(l—p)- 
2p, —1 where ;, 1s the probability that the points ¢ and ¢ + t will 
fall on the intervals on which X (f) and X (¢ + 7} have the same gn 

Since the displacement 7 on Pig 9 29a is uniformly distributed e 
cin transfer the reference pomt to the Ieft end of the interval wh eh 
includes the point ¢ and consider the point ¢ to be umformly distributed 





Fig $30 


intheinterval (OQ 1) (Fig 9 296) In this interpretation p, 1s the prob 
ability that the pomt (if + 7) will fall in exther of the yntervals 
(22 2n+1) n—O 4i 42 (these intersals are marked witt 
thick lines in Fig 9 295) let us calculate this probability for difierent 
vilues of T 

For 0 < + < f the point (¢ + +) may fall either in the interval (0 1, 
or in the interval (1 2) and therefore 

Pr Pitt trcip—-Plei—trp—1-—-t 

For 1 < t <{ 2 the point ¢ + t may fall either in the interval (i 2 
or in the interval (2 3) and therefore 

Py OP{t tf tr>2-Pt>2—y-1-—-@—1)-t-1 


Continuing with our reasoning we get 
pn—~{ 030 for 2rnatr<c2n41 
© Le 2n)—1 for Qn tt<cr<2n4 2 


It can be seen that p, (and hence R, (f ¢ + 1) = (2p, — 1) 8s well 
depends only on t and 1s in even function of t Consequently 
. dy +4 —2r for Qn<tv<l Qn +1 
Re t+ y— Bea fy oy fer ent ‘ ; 
2t —- (4m + 3) for Qn ttt ret ln + 
Fig 9 29¢ shows a graph of the correlation function 


930 A random function X {t) 1s a sequence of equidistant posit 
voltage pulses having the same width y <( 1/2 The beginning of eac 
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pulse is separated by a unit interval from the beginning of a next pulse 
(Fig. 9.302). The sequence of the pulses occupies a random position on 
the t-axis relative to the reference point (see the hypothesis of the 
preceding problem). The potential of the ith pulse V; is accidental 
(@= 4, 2, ...). All the random variables V; have the same distribu- 
tion with the mean value m, and variance Var, and are independent. 
Find the characteristics of the random function X (¢): the mean value, 
variance and correlation function. 

Solution. By the formula for the complete expectation m, = 
myy + 0-(1 — y) = m,y. We find the variance in terms of the second 
moment about the origin: a,[X (t)] =a,[Vily +0-(1—y)= 
(Var, + m2?) y. Hence 


Vary = a [X (t)] — m2 = (Var, + mi) y — my 
= » Var, + y (1 — y) mo. 


_ In this case the random function X (¢) is not centred. We shall seek 
ils correlation function proceeding from the second mixed moment 
about the origin: 


R, (t, t+) = MIX (t) X (¢ + 0) — mi. 


Let us find M {EX (¢) X (¢ + t)]. We use the complete expectation 
formula to calculate it. As in the preceding problem, we assume the 
f-axis to be covered with alternating intervals: the intervals marked 
with a thick line correspond to the pulses and those marked with a 
thin line correspond to the spaces between them. We denote by 7 the 
random value of the left-hand boundary of the interval (7, T + 1). 
Three hypotheses are possible: 

H,—both points 7 and T + 1 fall on the interval of the same pulse; 

l,—one of the points, 7 or 7 -+ t, falls on the interval of one pulse 
and the other on the interval of another pulse; 
ae one point, 7 or 7 + 7, falls outside of the intervals of 

ses, 

On the first hypothesis the variables X (7) and X (7 + +) coincide 
_ M [LX (T) X (T + 7t)] = MIV*] = Var, + m3. On the second 
'ypothesis the variables X (7) and X (7 + t) are independent random 
Variables with the same mean value m,; by the theorem on the multi- 
plication of expectations M [X (7) X (7 + t)] = m2. On the third 
'ypothesis M[X (7) X (7 + t)] = 0. The complete expectation 


M{AX (t) X (¢ + t)] = P{H,} (Var, + m2) + P{H,} m?. 


The probabilities P{H,} and P{H,} and hence the correlation 
nelion depend only on t: 


(1) for 0<t<y 
Ph} =y—1, P{H,} =0, MIX QX (t+ 0) = (y — 1) (Var, + m2) 
R(t) = (y — t) (Var, + m2) ~ ym}, 


fu 


294 Appiied Problems in Probability Theory 


(2) for yet tr<ti—y 
PU} = 0, P{,}=0, MIXX t+) =0. 
ft, (t) = 0 — yPin? x= —y2yn?, 
(3) for i—yerotr< f 
Ph} =0, P{i,} = »y—(t — 4), 
MIX ()X (+ l= ly— (1 — dam? 
Re (1) = (yp — 4 + 0 ~ 9%) mi 


The next intervals of the v uues of + can be investigated in the same 
Way 

The graph of the function fi, {tT} 1s shown in Fig 9308 For |+]> 
1/2 the curve A, (+) 13 repeated periodically, attaining local maxima 
equal to yp (1 — y) m? at integral valued points 

J 3i* We consider a stationary random function X (t), which isa 
sawtooth voltage (Fig 9 31a) The reference point occuptes a random 


Att} 


AE, 4 L 4 
fis’ L | ih 


go ofifere F A heft 


( 





Fig 9 3f 


position relative to the tooth, just as in Problem 9 29 Find the mean 
pane the vartance and the correlation function of the random function 
f 


Olution We can evsily find the mean value mt, if we take into 
account that X (t} has a uniform distribution on the interval (0, 1) 
for any ¢ Hence my, = t/2 

To, find the correlation function, we rigidly connect the sequence of 
teeth with the ¢ avis and throw the beginning ¢ of the interval ft, ¢ -+ +} 
at random on the ¢ axis (Fig 9 31b) Since the teeth are periodic its 
sufficient to throw the point # at random on the first interval (0 1) 
distributing it with constant density As can be seen from Fig 9 316, 
In that case X (t} = ¢ and the value X (¢ +. t) 1s equal to the fractronal 
part of the numbert+ 426 ¥ (§ -rp=ti+tr—E (t+ 1), where 
& (t¢ + td 1s the integer part of the number (tf + 1) 

If the mtecral part of the number tis x (2 T<t in +f), then 


it for t+tr<cm+d, 


BX{t+1) = m+i for t+ttnit, 
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and, hence, 
tt+tt—n for t<in+i1—tT, 
K+ =| mat on ae: oe 
From the formula for the mean value of the function of the random 
variable t we have, for nl t<on +1, 
{ 
MIX (t) X(t + 7)) = | X(t) X(t+0)-1-de 


0 
n+1—-t 1 
ey \ i(t+t—n)dt+ | t(t+t—n—1)dt 
0 n+1—1 
4 1 4 
=> (n+ 1—1) +4 (t—2) —-& 


(1 = 0, + 1, +- 2, ye 


It follows that the correlation function depends only on t and for 

n<xt<cn+i (n=O, +1, +2, ...) has the form 
R, (t, U) = R(t) = MIX (t) X (§ + 1)! — m3 
= 0.5 (n +1 — 1)? + (t — n)/2 — 5/12. 

This is a periodic function with unit period whose graph consists of 
periodically repeating segments of a parabola which are convex down- 
wards. In the interval 0 < t < 14 this parabola has the form R, (t) = 
(i — 7°)/2 + +/2 — 5/42 with vertex at a point (1/2, —1/24). Setting 

= 0, we get Var, = R, (0) = 1/12. 

9.32. We consider a linear transformation of n stochastic processes 
Xy(t), X,(t), ..., X,(é) of the form 


Y()}=o()+2 (Xi (0), 
Where ; (t)(i=0, 1, 2, ..., m) are nonrandom functions of time. 
We know the chatacteristics of the stochastic processes A; (€): 
mi(t), Var; (t), R(t, t’)(i=1, 2, ..., n) and the crosscorrelation 
functions Rij, vy=M (X, (¢) De (t’)] (tf, jd, 2, ...,n, i547). Find 


the characteristics of the stochastic process Y (#). 


Solution. m,, (t) = > (Pp; (t) m; (t). 


R(t t)=MIY OY EN=MID OO D oC) X, 0 
i= j= 


= 21 9: (i) p(t) Bilt, #) 
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F f 41 f F 
“+ x pr (2) Oy 7) Rey CE, B+ a,? (2°) py (2) Ay, (2, 2), 
ig 


Vax, (N= Ry (t, = Y GO Van (+2 Y ql) oO Ry (tt 


a=] igtj 


If the stochastic processes 4X, (i) (f=1,2, .. m) are uncorrelated 
(Ri (é, t')s20, +, fa 1, 2, , H}, then 


R, (t, t= yy Gy (2) py (t') By (2, t’), 


Var, = > 4 (t} Var; (t) 


9 33. Given two uncorrelated random function X (/) and ¥ (i) with 
characteristics 


m,(tj}=@, R(t, t) = etttt4), 
my (thi, Ry(t tere, 
find the characterrstics of the random function Z (£) = X (é) + #¥ (f) + 


tf? Solve the same problem given that the random functions X (f) and 


Y (2) are correlated and their crosscorrelated function Ay, (tf, f) = 
qge-S i—t ] 


Solution Tf A.,(f ty=0 then 
in, = in, (t)+- im, (£) + i = 22? + ¢, 
A(t ty Rt t)bit Ry (fe, Ppa ete ttet) 4 te etaltet 
If &,, (@, &) = aerp(—a|li— dz |), then m, {f) does not change, 
R(t ty=R(f t-te RG +R, C+tR yO 
SemnG+t) 1 gt peel tL a (pat jerelt-t 
$34 Find the mean value and the correlation function of the sum 


of two uncorrelated random functions X (¢} and Y (t} with characteris 
tics 


m,(t}= t, Ry (tt y= tl’, 
m, (t)= —t Ry(t, t’) = tt’ e&Utt ) 
Answer, m,(f) = im, () +m, (t}—0, Hi, ') =A, YyAk (t,t) 
_Answer, me(t) = ma(t) my (2 (f, t) = Re 
J3o Given a complex random function Z (t) = X (¢) + oY (i), 
where § is the imaginary unit X (t), Y (é) are uncorrelated random 
functions with characteristics 
Fit (t) == ¢?, ff, (i, Pysse Tulle t yy, 
My (f)= 1, R, (£ ¢ )—e2eslttt ), 


find the characternstrstics of the random function 7 {#) m, (2) 
f(t, #) and Var, (¢} 
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Answer. m,(t)=t?+i, R,(t, t’') = e7 es C-UY 4 eras (ttt), 
Var, (t)= R, (t, t’) = 1+ 4%. 


9,36. A complex random function Z (¢) is given in the form Z (7) = 
X (t) + iY (t), where 


3 3 
X()= 3} (tae, ¥ (t= 3 Ort Us) e 


k= 


The mean values of all the random variables V, and U;, (k = 1, 2, 3) 
are zero and the correlation matrix of the random variables (V,, Vo, Vs, 
U,, U,, U,) has the form 


10 QO 
2 0 
3 


em OO © Ee 
No Oo OF OC 
Cc fo: <a 


Oo 


Find the characteristics of the random function Z (t). 


3 3 
: met : —B,t 
Answer, m,(t)= >) a,e*h' +i >) bye PR', 
h=1 h=1 


R(t, ’)= R(t, U) +R, (t,t) tilRay (ls H—Ray(t, UY, 


where A, (é, t’)= y ke eke 
. h=1 | 
R, (t, t’) ma Lee, 
Rey (t’, t) = e- ait’ Bat peo" Git + 3e-ast’~ Bat, 
icone (t, t’) = e-1t-Bil’ — @-G2t-Bet” 1. Be-Gst—Bast’ | 


9.37. Correlation function of a product. Given two uncorrelated cen- 
tred random functions X (t) and Y (é) and their product Z (t) = X (t) Y (t), 
Prove that the correlation function of the product is equal to the product 
of the correlation functions of the factors: R, é,U) = Ry @,U) R, (0). 
F Solution. R, (¢, t’) = M IZ (t) Z (t’)); Z(t) = Z (t) — m, (t). Since 
- random functions X (t) and Y (¢) are uncorrelated and centred, it 
Ollows that m, (t) = m, (t) m, (t) = 0, hence 


Z(t)=X (Y(t) =X()Y (2), 
R(t, ')=M[XMY (MX) YI 
=M[X(t) X (I MIY ()¥ (y= Ry (t, ¢) Ry (6, ¢’). 
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In particular for? — it 
Var, (f) = Var, (t} Var, (¢ 
938 Prove that the correlation fonction of the product of independ 


ent centred random functions Z (¢} — |J 2, (2) 3s equal to the product 
i 


{= 
of the correlation functions of the factors 
Fr 
Ht, (¢ t)= f] Hx, (f t ) 
i=1 


Sofution The proof is simrlar to the preceding one the only drffer- 
ence betng that in order to use the theorem on the multiplication of 
mean values rt is insufficient in this case for the factor to be uncorre 
lated and it 18 sufhetent for them to be independent 


$39 A random function X (t) with characteristics m, (?} — 0 
R(t t}as subjected to a nonhomogeneous hnear transformation 
F(t) -— LE {XM} +e) 
where ¢ (t) 18 a nonrandom function Find the crosscorrelation function 
Ry, (t t} 
Solution We hve X()—X(th YQV—LE (X= LL (X WY} 


since when the random function ¥ (tj) 1s being centred the nonrandom 
term g({t} is eliminated hence 


Ryy (tt) =M[X (1) ¥ (ty) —M[X (t) 22 (XH 


=) {MPA a) XC y}=L {R(t 2) 


340 Charactervstics ef the dertwvative of a stochastic process There is a 
stochastic process A (t} with mean value m, (t) and correlation function 
A, (¢ t) Find the characteristics m, (£) A, (¢ t) and Var, (é) of 1s 
ar nan Y (t} -- dX (t)/dt Also find the crosscorrelated function 

ry (Ef 

Solution The random function } (é) 1s connected with X (2) by & 


homogeneous linear transformation Applying the general rules 
(907) (9908) (909) we obtain 


_ dm» (t) GtHy (i t | 
my (t) dt fiy(é t)— are: 


a 
Vary (t)—~(Ry(¢ ¢)]_, = [Se 


Ray (f t)-MIX() 3 @ a0 [xX @—_-X tt) | - oR, {t t) 
Note that 





Ryx(t t)=—— Ry (tt) 
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9.414. A random function X (¢) has characteristics m, (t) = 1 
and R,, (t, t’) = e«(+t’), Find the characteristics of the random function 


Y (t) = t£X () +1. Find out whether the random functions X (i) 
and Y (¢) are stationary. 
Solution. Since the transformation is (f) +. 4 is linear, 


My On tar m, (t)--1=4, 


R,(t, &) = tt’ R,.(t, t’) = tt'vtet th), 


aa 


Neither X (t) nor Y (é) is stationary since their correlation functions 
depend not only on t = t’ — t but also on each of the arguments £, f’. 
9.42. A random function X (¢) has characteristics 


Msg (t) = 7?-—1, R(t, t’) = Qe—@ Ct)? ° 
Find the characteristics of the random functions 
Y(iy=tX(t)+e+1, Z(t) =X (+2), 


d?X (t) 
dt* 


Solution. m, (¢) = im, (¢t) + 2+1=8+2—it+1, 
R, (t, t’) = 2tt’e-e—-™, 


vane (t) +U— 1? =1—2t +52, 


U (t) = +-4. 





R, (t) = Att! sr Re (t, U1) = (atte t-"¥ [1 — 20. (¢— 29], 
as 
my w(t) =m, (t) +1=3, ——— 
When calculating R,(t, t’') we have found => ar R..(t, t’) and, con- 
sequently, 
A, (t, U) = sur {4Zae-%-t' ff — Qo (t — t’)?] 


= Sa2e -a(i—-t’)? (3+ 4q2 (t’ — t)4— 12a (t—t’)?]. 


9.43. A random function X (f) is specified by the expression X (t) = 
"cos wf. where V is a random variable with characteristics m, = 2, 
O.=3. Find the characteristics of the random function X(t): m x(t); 
R.(t, t’), Var, (t). Determine whether the random function X (t) is 
tatlonary, Find the characterististics of the random function Y (¢) = 


d 
A(t) t+a5-X (t), where @ is a nonrandom variable. Is the random 
function y (¢) stationary? 
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Solution. 
nm, (t} =m, cos wt = 2 cos wt, 
R.(£, t'} = Var, cos wt c08 @ f' = 9 cos ai cos wt", 
Var, (4) = 9 (cos wt)? 


We can represent the random function Y (2) thus 
Y ()=Vecoswot+ea + Y cos mt = V (cos mf — ao sin wf), 


whence we have m, (t) = m, (cos mt— aw sin wf) = 2 (C08 Of — aw sin at), 
R(t t}—-9(cosat—ao sin wf} (cas at — am sin at’), 
Var, (t) = 9 (cos of — am sin wt}? 


The random functions X (t) and Y () are nonstationary 

9 44 A telephone exchange receives an elementary flow of requests 
with intensity 4 A random function X (£) 1s the nimber of requests 
received by the evchange during the time ¢ (see Problem 9 423) Find 
the characteristics of its derivative Y ét} 

Solution. In the ordinary sense, a disconfanacds tTandom function, 
which is a Poisson process 1s not differentiable However, using the 
generalized delta-function, we can write the characteristics of the 
derivative The transfarmation FY (ft) = dX (t\/dt, which relates the 
random functions Y (t) and X (é), 1s a homogeneous linear transfer- 
mation Therefore, from Problem 913 we have 


d a 


R _ 
7 
of 


= Sfa(t—t)8(t—t) FA C—O, 


a P ! 
(latte! — 4 at 1 (¢—2')t) 


but 
(¢—t)S5(¢—i)=0, 
whence 
Ry (t,t) =-S (MM (t—2/)) = 28 (t— 0) = 48 (0) 


Thus, the correlation function of the random fitnction Y (t) 1s pro 
portional to the delta function, 1e the function Y (¢} 1s stationary 
white noise with intensity G = 4 and the average Texel my, = » 6 ‘The 
spectral density of such a white noise 1s 


* 1 A 
Sj@)=ss | Maem da— 
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9.45. Find the characteristics of the stochastic process Y (t) which 
is equal to the derivative of the Wiener process X (t) in Problem (9.25), 
ie. Y(t) = +X (1). 

Solution. Since m, (¢) = 0, it follows that m, () = 0. The correlation 
functions of the Wiener and Poisson processes are equal (with an accur- 
acy to within a constant factor). Therefore, the correlation function of 
the derivative of the Wiener process (see the solution of the preceding 
problem) is proportional to the delta-function and the process Y (é) 
itself is stationary white noise. 

9.46. Prove that the derivative of the process of a homogeneous ran- 
dom walk (Brownian movement) of a particle (see Problem 9.24) is 
stationary white noise. 

Hint. Use the solution of Problem 9.44. 

9.47. Characteristics of the integral of a stochastic process. Given a 
stochastic process X (¢) and its characteristics m, (t), Rx (t, U), find 
the characteristics m, (¢), Ry (t, t') of the integral of the stochastic pro- 

t 


cess Y (t) = \ X (t) dt and the crosscorrelation function R,, (f, t’). 
Solution. 


t 
My (z) aa Mm (tf) dt, R, (Z, t”) = \ \ R. (T, t’) at dt’. 
0 


aoe) 


t t’ 
Vary (t)= | | Ry(t, tate’, Rey(t, U)= \ Ret, v) ae. 
0 


0 


S 


Note that 
t 
Rye (t, OC) = | R, (t, t’) dt. 
0 


We can prove that there is no random function X (t) different from 
zero for which Y (£) is stationary. 

48. A random function X(t) has the following characteristics: 
mx(t)=0, R(t, )=[1—(t'—#)2]"!. Find the characteristics of the 
random function Y (t)= | X (2) dt. Determine whether the random 


0 
functions X(t) and Y(t) are stationary. 
{ 
Solution. Since the transformation | x (£) dtis linear, 
0 
is 


t 
m,(t)dt=0, R,(t, t')= \ dt | 2 (t, t’) dt’ 
0 


0 


My (i) = 
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t 3 
= | ({u+a"— yt de’ } de 
0 0 
t arctan ¢-+2’ arctan ¢’—({t—2’} arctan (f—?f') 


—F int ey (tee tt eyes}. 
The random function X (t) 1s statronary A, (ff, ) = A, ft — t’), 
tbe random function Y (t} = { X (t) dt 1s nonstationary Indeed, the 


0 
variance of the random function is Var, (t} = Ay (if, t} = 2t arctan? — 
In (1 + 2, 1e the variance depends on ? 

9.49 <A random function X(t) with characteristics m, (t)=1?+3, 
R(t t’}== Sit’ 1s subjected to a linear transformation of the form 


t 
Y(t)= |X ()dr+e. 
0 


Find the characteristics of the random function Y (f} m,(f), Ay (4, £)- 
Solution. 


t 


m, (t) = c(t d)dtp he $45 eyes, 


The homogeneous part of the linear transformation being considered 18 
f 
EO 8X (t}} == \ X(t) dt. 
st 


Consequently, 


t t’ 


AR, (i, U)= l at te (t wiydt =5 \ vx ( \ a'r’ at) dua {3 (7’}*. 
G0 0 0 


350. A random function X (f), with characteristics m, ft) = 0 and 
Ai, (f, £) = det} 1s subjected to a linear transformation of the form 


‘ f 
¥ (t)= —t2 X (a4. | 2X (0) det sinct. 
0 


Find the covariance of the random vanables X (0) and Y (1) (ge of two 
sections of the random funetions X (t) for ¢ = 0 and ¥ (¢’) for 2’ = 1). 
Solution. On the basis of the solution of the preceding problem 


Rey (ft, f= Lf? {R.. (f, ty}, 
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where Li?’ is the homogeneous part of the linear transformation applied 
to the argument t’. In this case 
(+i) f 


’ , Oe Picks ’ ’ 
Ryy (t, U) = — 3t <a eo \ xe CEE) dt 
0 


== Bt’e- (ttt 1 Bem! [e-# (— 2’ — 1) + 1] = 3e7* (1—e-?*’). 
Setting ¢<=0, ¢’= 1, we obtain 
Covy (0), ¥Y (4) — Roy (0, 1) — 5 (4—e) AS 4.90. 


9.51. A random input signal X (¢) is transformed by a relay into a 
random output signal Y (t) which is in a nonlinear relationship with 
X (i): Y (t) = sign X (ft), ive. 


1 for X ()>0, 
Y (i) = QO for X (t) =Q, 
—l for X (t)< (0. 


The input signal is the random function X (t) considered in Problem 
9.45. Find the distribution of a section of the random function Y (f) 
and its characteristics m, (#), Ry (é, U). 

Solution. The random function Y(¢) can assume only two val- 
ues +4 and —1; the value 0 can be neglected since P {X (#)= 0}=0. 
The probability that X (t)>> 0 is p= \ o({x)dx. The ordered series 

0 
of the random variable Y (¢) has the form 


—4i| +41 
i—pj} p 


Hence my, = 2p — 41, Var, = 1 — (2p — 1)? = 4p (1 — p). 

Assume t = t’ — ft and t’ >t. If no event occurred in the Poisson 
llow during the time t (and the probability of this is e~*t), then the 
values of the random function Y (t) and Y (¢’) are equal to each other 
and the conditional correlation function R, (t,t’) = Var, = 4p (1 — p). 
Now if at least one event occurred during the time t, then Y (t) and 
' (f) are uncorrelated and the conditional correlation function R, (t, t’) 
‘iS zero. Hence, for t’ >t 


Ry (é, t')=e-**4p (4— p), 
and in a general case (for any é and 2’) 
R(t, t')= Ry (t)=e7*'*! 4p (1 — p). 


9.52. The random input signal X (t) considered in Problem 9.15 is 
lransformed into a random output signal Y (¢) by means of a relay 


Tr). 
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with a dead bind 
\" sian X(t} for {X (¢)| es, 
= 1 9 for (X(t) <e, 


where ¢ 18 the dead band of the relay 
Find the distribution of the section of the random function Y (£) and 
rts characteristics the mean value and the correlation function 
Solution The random variable ¥ (f} may assume one of the three 
values —t, 0, 1, for any # and has an ordered series 


—i | o | +1 


au Fy Pa Py 








where 
—~ - 


P= PLAY) a—s}= \ p(x) de, 


F 
Pp = P{|X (t)| <e}= \ g(z}dz, py=1—p,—P, 
-¢ 


Hence My = Pa— py Vary= py + Ps —{P3— A) 
Reasoning as we did in the preceding problem, we find the corre- 
lation function 


Ry(t}=e Bl (py + py—(p3— Py)? 
Jod A random function X (f) 1s transformed tnto a random function 





nig 953 


¥ ({) by means of a nonlinear device whose operation 1s described by 
the formula 


—be for <A {t)<t—e, 
Y(t)=:¢6X(t) for |X (é| <e, 
be for A(ij)=e 
The graph of the relationship of y (z) 1s shown m Fig 9 53¢ 
The random funetion XY (f) considered in Problem ? 16 arrives at 
the input of the device Find the univariate distribution of the random 
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function Y (#) and its characteristics: mean value and correlation 
function. 

Solution. The random variable Y (£), a section of the random function 
Y (i), has a continuous distribution in the open interval (—be, -+-be) 
and, in addition, discrete possible values —be and -+-be with a nonzero 
probability. Thus the section Y (¢) is a mixed random variable whose 
distribution function F (y) is continuous on the interval (—be, +-be) 
and suffers discontinuities at the end-points of the interval (points 
—be and +be). The jumps of F (¢) at the points of discontinuity are 


—& 


P{Y (t) = —be} =P {X(t)<—e}= | p(2)dr=py 


P{Y (t)= +-be}=P{X (t)>s}= | p(c)dx=py 


_ Let us find the distribution function of the random variable Y (é) 
in the interval (—be; -L des): 
i y/b 
F(y)=P{Y ) <y}=P{X() <F} = | o(a)dc 
y/b 
= Py+ \ (x) dx (—be<y <a). 

—€ 

The graph of the distribution function F (y) is shown in Fig. 9.530. 


_ The distribution density of the mixed random variable Y (t) in the 
interval (—be, -+-be) is equal to the derivative of F (y) on that interval: 


fY)=F'(y) =F olyld) for —be<y<+be. 


The characteristics of the random function Y (t) are 
' be 
ity (t) = my = —bepr-+bep+— \ yp (+) ay 
—be 
é 
=be(pp—ps) +b | ze (2) de, 
—£ 


Vary (t) = [Y (¢)] —mj = (eb)? (py + py) 


be 
4 ¥ i 9 
+ y2Q (+) dy — my = Vary. 
—be 
7 analogy with the preceding problems R, (t) = Var, e-Mt!, 
ook, Consider a random function X (t) = W cos (o,~ — ©), where 
IS a centred random variable with variance Var,,, 0 is a random 
“0~0575 
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variable distributed with constant density in the interval (0, 2n), 
and ©), 1s a nonrandom parameter (wm, > 0). The random variables W 
and @ are mutually independent. Find the mean yalue and the correla- 
tion function of the random function X () Determine whether the 
random function X (£) 1s statronary and ergodic, If it 1s stationary, 
then find its spectral density S, {w) 





Fig. 9.54 


Solution. We represent the random function X (#} in the form 
X (i) = Wecos (o,t — OF} = W cos 6 cos wf + Wsin 6 sin oy, 


We designate T¥ cos 0 = U, W sin O = VF and find the main charac- 
teristics of the system of random variables @ and V 


M [7] = M [i¥ cos Oj = M [VW] Mfcos 6] =0, 
M[Vi=m MEP sn O] = MEI] M [sin O] =0, 
Var [U7] = M [(1¥ cos O}7|] = M [72] M [cos? O] = Var,, M [cos? O], 
Var (Vj = MG sin 6}7] = M [T¥2] M (sin? @] = Var,, M [sin? 9), 
Ruy = MW cos O W stn @] = Var,,M [sin O cos 0}. 


Since the value of © 1s distributed uniformly in the interval (0, 27), 
we have 
210 ‘ ‘ 
M [sin? O} = KI [cos? 0] = \ cos? ar dz==> ' 
0 
ra 4 
M [sin O cos O7] = SIn TCOS x oq GE = 0), 
0 


Thus M[V] = M{V] = 0, Var[U] = Var[V] = Var,/2, Rus = 2. 
Consequently, the expression 


X (t) = Weos (@,¢ — 9) = U cos o,f + V sin ayf 


is a spectral decomposition of a stationary random function! m, = 0, 
and the correlation function has the form A, {t) = (Vary cos OZ 
The graph of this function 1s shown 1n Fig. 9 54 

The random function X ({#} 1s not ergodic since the characteristics 
found from one realization do not coincide with those determined from 
several realizations, Indeed, every realization of the random function 
X (t) 1s a harmonic oscillation whose amplitude is a value assumed at 
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random by the variable W. The time average of each realization is zero 
and coincides with the mean value of the random function X (¢), but 
the variance and the correlation function, found as time averages 
for one realization, do not coincide with the corresponding character- 
istics of the random function X (¢). For instance, 
{ i t 1 1 

= _¢ __ 1 pe 
lim oF al (t) dae od lle dias (w,t— O)} dt = 5 W?, 

Let us find the spectral density of the random function X (1). We 
shall show that it is proportional to the delta-function: S, (@) = 
Var,,6 (® — w,)/2 (0 << wm < oo). Indeed, for such a spectral density 
the correlation function 


oo 


R, (t) = \ S,,(@) cos wt dw 


Va 


Var r 
w ors COS ,T, 


2 





0 
= \ 5 (@ — @,) COS @T dw= 
0 
which coincides with the correlation function for X (t). And since the 
direct and inverse Fourier transformations define the spectral density 
and the correlation function one-to-one, the expression for S,. (w) writ- 
ten above yields the spectral density of the random function X (t). 
If we use the complex form of the Fourier transformations rather 
than a real one, we get the spectral density S% (w) in the form 


Sz (w) = Var,, [6 (@ + @,) +6 (o—@,)]/4  (—~0o <o< 0). 


Note that by analogy we could also write S,,(@) = Var, [6 (@-+@,) + 
§(@—a,)|/2, but 6(@-+0,) =0 for positive w (since w, > 0). 
9.55. Show that the sum of elementary random functions of the form 


X (1) =m,+ 2) Ws 00s (ot-+ %), 


Where W; are centred random variables with variance Var; (i = 
0,4, 2,...), 0; is a random variable uniformly distributed on the 
Interval (0, 2) (i = 0, 1, 2, ...) (all the random variables W;, 0; 
being independent), is the spectral decomposition (9.0.24) of the 
random function X (t). 

Solution. In accordance with the solution of the preceding problem 


W; cos (a;t — O;) =U; cos ot + V; sin a;t, 


Whero U; and V; are uncorrelated random variables with zero mean 
Values, Consequently 


A (t)=m,+ 2s (U;cosa@,t-+V; sin ; t), 


and this is what we wished to prove. 
ane 
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Tt 


956 Consider a stochastic process Y {t}= 4 a,X,{t)4-6 where 
i= 


X, (t) are stationary uncorrelated stochastic ptocesses with character 
istics m, AR, (t) and Silo) —1 2 7) a;, 6 being real num 
bers Find the characteristics of the stochastic process }¥ (#) 


ri Fe * 
Answer my — 23 a;m,-+b Ry (0) = 24 ai, (1) St (co) = 2 a}? (o) 


i= 


The stochastic process } (¢} 1s stationary 
957 Consider a stochastic process Y (t)—- [| X, (2) where X; (i) 
i=! 


are Independent stationary stochastic processes with characteristics m, 
=0 #, (t} andS? {a} (i-—-1 2 ny) Find tlese characteristic* 
Answer 


hy if my, Fy (t}— fl fy (T} $$ (0) —s { [| £2, (ry eft it 
—1 [=1 oo jor 
The process Y (¢} 15 stationary 
958 Find the characteristics of the random function X (t) whose 
spectral decomposition is given in Problem 9 95 
Solution We designate IV; (cos wt — O) = X, (t} and then 


X(}=met+ Le X(t 
In accordance with the solution of problems 9 54 and 9 56 we have 


M{A ()}—m, Re(t)= Dd) Re, (t= D) Var, cos ot 
i—1 i—1 


53 (0) = yy ae [b(@+a)+6(o—a@)] (-o <co<~) 
i—! 


The random function X (t) 1s stationary but not ergodic 

959 Consider a product of tno uncorrelated stationary random 
functions Z(t} — X (ft) Y(t) the random function X (#) being the 
same as in Problem 9 14 (a random alternation of the values 4-1 and 
—1 with an elementary flow of sign changes} and the random function 
Y (t) the same as in Problem 954 Find the characteristics of the 
random function Z ({t) 

Solution We have m, (}— m,(t)=0 m,(t) =0 A(t t)= 
e *Alvl and Ry, (t t} = (Var,, cos w,t)/2 (t —~ t — £} On the basis 
of Problem 9 57 


Ai(t t)-—A,(¢ t) Ry, t)}=(Var,er*47 cos w,7)/2 
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Fig. 9.59 shows one of the possible realizations of the random function 
Z(t) which is obtained by multiplying the corresponding ordinates of 
the realizations of the random functions X (¢) and Y (#). 

9,60*. The criterion of positive definiteness. We have a function &,, (tT) 
with properties 


(1) Ry(—t)=Ry (1), (2) Re (00, (8) [Re (DSR, (9). 


Find out whether the function A, (t) may be a correlation function 
of a stationary random function, i.e. whether it has the property of 
positive definiteness. Show that 
the sufficient condition for positive 
definiteness is the condition that 
the function 


Sx (@) == \ R,, (t) cos wt at 
0 


(9.60.1) 
be nonnegative for any value of o, 


S.(@)>0, (9.60.2) 


le. that when calculating the spec- 

tral density by formula (9.60.1), 

We should not get negative values 

of this function for any a. 
Solution. We assume S.,(w)>>0 Fig. 9.59 

and prove that in that case 

the function R, (t) = Ry (t — t’) is positive definite. We have 





©o 


R.. (t) = \ S,,(@) CoS at dw 
0 
| 


S,.(@) cos wt cos wt’ dw + \ S,(@) sin of sinwt’do. (9.60.3) 
0 


The positive definiteness of the function R, ({—t') means that for 


the function @ (Z) and any domain of integration (&) the following con- 
ition must be fulfilled: 


\ | Ry (t—2') p(t) 9 (t') dt dt’ 0. 
(B) (B) 
Let us verify this inequality with respect to function (9.60.3): 


) it S,, (@) cos wt cos wt’ — (t) p(t’) dw 
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S,(o) sin wt sin wi’ p (2) p(t) do} at dt’ 


-{- 


l 


S, (a) { | cos wt g(t) dt \ cos wt" @ (t!) dt’ 
(B) (B) 


sin at p (t) dt \ sin ot’ p(t’) at | dw. 
(B) 


-{- 


5 


Designating 


| cos ctg (t) dt = 4, (B. ©), \ sin at p(t) dt =p, (B, ©), 
(B} {B) 


we obtarn 


R, (tt) p (t) p(t") dt de’ 


{2} £8) 
— S2(o) (yi (Bs o))*+ [f. (8, @}}) dor 0, 
G 


since by the hypothesis S, (@) = 0 

We can prove that condition (9 60 3) 1s not only sufficient but also 
necessary for the correlation function to be positive definite 

9.61*. Find out whether the function 


R(t} = e- #1 (cosh pt+-7 sinh B 1! } (a>>0, Bo 0) 


possesses the properties of a correlation function, 
Solution. We must verify that it has the following properties’ 


(1) iy (0) _* QO, {2} be (—-7) — H. (t}, (3) R. (t) = iy (0), 


(43 Sto)=— \ Hy (tje7*tdr0 for any wo 


— 


Properties (1) and (2} are obvious. Let us verify the others. 
(3) The function A, (t) 1s even and, therefore, it 15 sufficient to 1- 
vestigate its behaviour for t= 0. 


1 th | 
— —p-lac=-BH i — — — pute mn 
R,(t}= +8 (++ 4) x & tare ( 5 1). 
Since FR, (0) = 1, this expression cannot exceed unity in absolute 
value For a <¢ Bf this condition 1s not fulfilled since e~(@—f)t increases 
wndefinitely as tT + oo, lia = f, we get A, (t} = 1, and for a > B we 
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have —R, (t) <1. Thus property (3) is fulfilled only for a > p. 


(4) Si (0) = [ Ry (senor de= A Re{ (1+) 


— 0O 


c . os c at 3 
x e-(a-BHion dr + (1—4] e~(a+8tion dr} 
1 Bo pB—a 
= 9, Re | a—p+io + =a ray 
2 — BP _ 4 \ 
~ 2B (wore (a+ B)?-+ 0° 
q2—B2 ”) 


9 4 
=a (a —f)?-F @?] [(@ +B)? + 07] 





for a > 6 (Re is the real part of a complex number). For a = fh we have 
Sz (o) = 6 (@). 


oF 
Thus for a> the function f, (q).S=-0- She (cosh Bt + x 


xsinh B ||) possesses all the properties of a correlation function. 
The graphs of R,(t) and St () for a> are shown in Fig. 9.614, b. 





LOE 
eae) ~|Sz (@) 
Ry (C) le al 
0 4 D 7a) 
(a) (6) 


Fig. 9.61 


9.62. Show that there is no stationary random function X (¢) whose 
correlation function R,. (t) is constant In some interval (—7, T,) and 
equal to zero in its exterior. 

Solution. Let us assume the contrary, i.e. that there is a random func- 
tion X (¢) for which the correlation function is equal to b > O for |t| <7, 
and to zero for | t | >> 7,. We shall try to find the spectral density 
of the random function X (t): 


oO 


T 
4 b Sin WT 
8, (0) == | R,,(t) cos @t dt = — | bcos ot dt =—————1 
0 0 


It can be seen from this expression that the function S,, (w) is negative 
or some values of w, and this contradicts the properties of the spectral 
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density and, consequently, there can be no correlation function of the 
kind described 

9.63 Does the function R, (tj) = Var, e enaiel & sin Bp ft | possess 
the properties of a correlation function? 

Answer. No, it does not, since the following two conditions are not 
fulfilled #.. (0) => 0 and R,. (O) => | BR, (4) | 

9.64 <A stationary random funetion X (¢{) has the characteristics m, 
and A, {t) Find the crosscorrelation function A,, (i, é'} of the random 
function X (¢} and of the random function Y (¢} = ={—X (t} 

Solution. 


Rey ht)= MIX OP C= MI-X (OX 
= —R, (t, t') = —R, (1) 
9.65. A random function X (t) has the characteristics m,, Ax (t} = 


Var, elt! Find its spectral density 
Solution. 


SF (@ = \ R. () etiot dt = ae Re \ _—(t+iOt dr, 
_ 0 
where Re ts the real part. We have 








| entation at = { =r e~fabiods d (ga +i} Tt 
0 0 
(a+tiojt=y See 
= _ -_ 1 - 
—|for t—0, y=0 =o \e v dy 
for T= co, Y= co 0 


i c i 
—— ee = t — —— 
0 


— He _i —~1o _. Do == te 





a ato” + oF 
wo —_* 
Consequently, S}(w)= =a =r 


9.66. Find the spectral density of the random function X (f) if us 
correlation function 


Bee Ue OE CU Pt. 
Answer. 


_ Varga a*-+ BI+ wt 
52(0) = > Tat po PEO - 


Ch. 9, Random Functions 343: 


Hint. Represent cos Bt = (et + e-ift)/2 and use the solution of 


Problem 9.65. | | 
9.67. Find the spectral density of a stationary random function whose 


correlation function 
R,, (t) = Var, en”, 


Solution. We have 


ro) 

Var 3 
Sx (w) = = \ Var, 7 (AT)? g-10T dz = a \ e~ (At)? -10t dr, 
— 00 


— OO 


Using the familiar formula 


( Q~Ax%t2Bx~C dar = if = exp | -S I (A > 0) 


—& 


and bearing in mind that i? = —1, we get 
Var Tt 0? 7 Vary ot 
The graph of this function is like that of a normal distribution. 


R(t) = 2a a 





(a) (6) 
Fig. 9.68 


9.68. The spectral density of a stationary random function X (t) is 
Constant on the interval from —@, to -++@, and zero outside it, i.e. 
has the form shown in Fig. 9.68a: 


a for at a | 
¥ oe _— —— 
S$(0)=| 5 for [@| > a, at (4 Q@; ). 


Find the correlation function R. (t) of the random function X (2). 
Solution. 


co 3] 

: . 2a SiN @,T 
R,. (T) = Sx (@) et dw = 2a {cos cr denn 228i Ore 

— OO 0 


Var, = R, (0) = 2a0,. 


The graph of the correlation function is shown in Fig. 9.68d. 
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9 69. The derivative of a stationary random function Given a station 
ary random function with m, (f) = m,, Hy (i, ¢) = H, (1), where 
T=: t -- 7, find the characteristics of 1ts derivative Y (t) = dX (H/dé 
and show that 14 1s stationary too 

Solution Since Y (2) 1s related to X (¢} via a homogeneous linear 
transformation it follows that 

d a 
my (t)= = m, (1) = Gm, =U=const, 
4 
créer 
a a g ref oT 
=o (Gr Fe) =F (HO a) 
But ét/dt’ = 1 and dy/dt — —1 and, therefore, 


1 ofa a2 a dt 
fiy (t, t= | R,(*) |= Sqr Rs (1) <= — +> R, (1) 


Since the right hand side of the equation depends only on Tt we have 


3 
R(t t) = Ry (t)= ~ ay Ae (Tt), 


= 
Rye U)= aia Balt t= seq Aa lO 


and the random functron Y (?) 18 stationary 

970 A stationary random function X é¢) has a correlation function 
R,.(t) Arandom function Y (t} results from its differentintion Y (f} = 
dX (t)idt Find the correlation function Ay {t) 1f 


(a) H(t) =e alt, = (b) R(t) =e HNL +a /T)), 


(c) #&. (T) = e-oHtl (cos ft-+ 2 sin BIT 1] (a>0, B>0) 


Solution To solve the problem we shall use the apparatus of gener 
alized functions, the rules for which are given in Appendix 6 


__. aa da d 
(a) Ay (t)= —gye t= — [ —ae~ art St ] 


= — af ditl 12, ait 
af oe eit (>) +—pyr78 ae | 

== 7a fT] [26 (t) —a@ (sign t}?] 
f The presence of the term 26 {t} shows that there 15 white noise mM the 
function Y (£) Next we write the answers and invite the reader to verify 

m, 
(b} iy (T) — 2e-clt] if — oF |t|} 
(c) Ay (t) = (a? -+ BY) eat (cosBt———-sin B il } 


9 71. Find the spectral density of a statronary random function with 
a correlation function 


Ry (1) = ae 4811 [25 (x) ~~ @ (sign +)*} 
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Solution. 
4 c _3 
St (o) =>— \ R, (1) e~#t dt 
1 e = 4 _ 4 i 2e-altig—tot dr, 
=, | ge =ltl2§ (t)e at dt D5 J (sign t)“e fs) 
Since 


sign =| for t=0, 
5 0 for t=O 


and since the integrand of the second integral has no singularities at 
the point t = 0, we can neglect + = 0 in 
the second integral. We get 





The graph of the spectral density Sy (@) 
is shown in Fig. 9.74. “3. 9.74 

We could have obtained the spectral Pig. v. 
density S% (wm) in a simpler way. We ses, 
represent the random function Y (é) as the derivative of the random 
function X (¢) from Problem 9.70 (a). We have 


4 
R,. (t) = e-aitl, Sk (ow) = aa 


The amplitude-frequency characteristic of the differentiation operator 
is M (iw) = iw, and, consequently, 
x ae 4 ‘od ero & Fe 
Sy (w) = Sz (@) |D (io)| = ate liw| =a aw « 

9.72. Given a stationary random function X (#) with a correlation 
function R.. (t) = (sin +)/t, find the correlation function, variance and 
spectral density of its derivative: Y (t) = dX (¢)/dt. 

Solution. According to the solution of Problem 9.69, 


d*Rxe(t) d* (=2*) 
Ry (t)= ——~ga = ae 





Expanding (sin t)/t into a Maclaurin series, we get 


sint | 1 | t «6 | 
—— =l-a 5) = sat eee 
d= 
Hy (t) = —-oe 


Hence Var, = R, (0) = 4/3. 
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The spectral density $(o) => 1(1-—-[mj}) (see item 10 of Appen 


dix 6) Consequently, S$ (o) = St (a) w= of (1—o}) 
973 A random function X (t) has o correlation function 


#H,(t)=e oH (cosh Br + + sinh B II) (a> f > 0) 


A random function Y (t) = dX ({)/dt Find its correlation function 
R, (t) and spectral density S$} (w} 

Solution To find R, (t), we use the properties of generalized func 
tions (see [40)) 


a 
Ry, (t)= a fit, (t}—- a [ —e-attlg, St (cosh fit 





4% sinh§ [t]) +e ot (B sinh Br-+ cosh B jx] EE 


)] 





=a (Ste cl ti sinh Bt) 
_ oP _& 
= | cosh f || : stoh B [| | | 


+ _ Zea ai pi? 
$0) = 2 eo oe OT 
Since the bmit hm &, (t) exists (at 1s equal to A, (0) = a? — B), 
~0 

the random function A (t) 1s differentiable 

9 74 Show that the crosscorrelation function R,, (t ¢) of a station- 
ary random function X(t) and its derivative Y () = dX (ide 
satisfies the condition R,, (t, £) = ~R,, (t, #),1¢ changes when the 
arguments change places 

Solution Assume ff, (t, ¢} = Ry (ty, where t = t 1 


Ray(ty “= MX (t) 2 XY] = S MIKO XE N= GR 
But t=f —# and, consequently, 


Hxy (és )= = R(t) ==, (0) 


On the other hand, 
Ry(t, N= Rg (t t)= RB (1) ea LR, = — Ray lt t) 
of a a fies = AUG = — Gp = “uN 


and thai w:what-we bed io prove 
Thus the crosscorrelation function of a stationary random function 
and its derivatiye depends only on t=? —2 


Reyy (T) = — Ry (t}, 


ti 
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ie. the function X (¢) and its derivative are “stationary correlated”. 
9.75. Prove that any stationary random function X (t) and the value 
of its derivative Y (t) = dX (t)/dt at the same point ¢ are uncorrelated, 
and if the random function X (t) has a normal distribution, then they 
are, in addition, independent. 
Solution. It was shown in the preceding problem that R,, (t)= 


d ’ 
d d 


Thus a stationary random function at any point is not correlated with 
its derivative at the same point. 

For a normally distributed random function, the lack of correlation 
between X (t) and its derivative at the same point implies their in- 
dependence. 

; Lah Find the characteristics of a random function Y (t)=X (t) x 
t 


—7 if the normal random function X (¢) is stationary and has 


characteristics m,, R,.(t) = Var et (cos Bt +- + sin Br) 


Solution. ¥(t)=7 SEO We designate X2(t) = Z(t). In accor- 
dance with (9.0.35) and (9.0.36), we have 


mz, = my + R, (0) = mz + Var, 
S? (@) == 2 | S%(@—v) Sx (v) dv + 4m3S% (0) 
_ Vara co? (Ww? + 20a? -+- 4B?) 
=a (OE BY) TSE tak aR — SOB] (GEE AGL 
9 Vara 2 (a2 -{- B*) __ OK, 
+ ts Torpek— pep same = 5H (): 





We can find the correlation function R, (t) from the expression 


R,(t) = \ SF (w) e79t dw. 
Hence ; 
m, (t) = - << m, =0, Sj(o)= + w2S> (@). 


<> Quadratic rectification of a stationary random function. A quad- 
7 rectification of a random function X (t) is a nonlinear transfor- 
= lon of the form Z(t) = a°X* (t), where a is a constant and X (2) is 
: ‘ndom function. Find the characteristics of the random function at 

© output of a quadratic rectifier with parameter a = 2 if a norma] 
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stationary function with characteristics my = 3, Ry (t) = deat 
arrives at its input 

Solution. We designate X, (f) = aX (¢) The characteristics of the 
random function X, {i} are m,, = am, = 6, Ry, (1) = aR, (2) = 
{Ge-2|tt Then Z (t) = Xj (2) We set Var, = 16, a, = 3 From formula 
(9035) we find that m, = mi, + As, (0) = 36 +16 = 02 From 
formula (9 0 36) 


St(o)=2 | St, (o—v) S$, (v) dot Amt, Sz, (o) 











_ j Var, a, 1 Var, tt, { hy 

a tt a7 +- (wo — v)? T a? va 

L 4m? Var, a i _ 4Varia, i 4 Vary amy, 
a tor poe (afar) 


Consequently (see item 6 in Appendix 7}, 
R, (1) = Ry () + Ry (1) = Var, e-1"| + Var, eas! 


where Var, = 2Var] = 2 x 16° = 512, Ol, = 2¢,=6, Var = 
4Var, m2, = 4 x 16 x 6? = 2304, a, =3 

Thus the signal at the output of a quadratic rectifier can be represent 
ed as the sum of two uncorrelated stationary stochastic processes 
Z(t) = X, (8 + X, (t) with the charactemstics indicated above It 
should be emphasized that the stochastic process Z (¢) 1s not normal 

9.78. A normal random function X (t) has characteristics m,, A, (1) = 
Var,e~#lt! Find the characteristics of the random function HW (#)= 


ax 


Solution 








X 
W (t) =X (1) HO =. x2 (2), 


St (w} = 0 5283s (ow). 
Since the differentiation is linear, we have m, {t) = cs Mya {f) But 
in accordance with the solution of the preceding problem, Mg: (f} = 
const and, consequently, m,,(t) = 0 In the preceding problem we 
found the spectral density S,. {w), and, consequently, 





_ i Var22 a 2 Var miaw? 
Sh (o) = 7 Si (0) = SE ray tet raty 


and in accordance with item 18 of Appendix 7 we have 


R,, (1) = Sate e— 2e{t! (26 (1) — 20 (sign T)*] 


2 Var, mi 
2 Yate me 


e- etl (26 (c} —o (sign T)"] 
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We infer from the form of the correlation function #,, (t) that the 
random function W (£) contains white noise. 

9.79. The angle of displacement of a radar in the horizontal plane 
is a normal stochastic process X (t) with mean value m, = 0 and 
correlation function R, (t) = Var, e~*lt! cos Bt, where Var, = 4 deg’; 

= 10-* i/s; 8 = 0.4 1/s. At the initial moment ¢ = 0 the displace-~ 
ment angle is zero: X (QO) = O. Find the probability p that at the moment 
‘= 0.2 s the displacement angle will be smaller than 1”. 

Solution. We designate X (0) = Xo, X (f,) = X,. Under the con- 
dition that the random variable X, = 7%, we can find the conditional 
distribution of the random variable X, from the expression f (a, |Z) = 
I (ty, Xo)/f (x,), where f (z,, z,) is a normal distribution of a system of 
two random variables with characteristics m, = m, = 0; 


Var, = Vary = Var,, = 4 deg’, 
Rey, xg = Rx (0.2) = Var,, en *!%4! cos B X 0.2 = 3.68 deg’, 


lxe1, x9 = Rx, aly Vars,; Vary = (),921. 


The conditional distribution f (z, |x) = 0) is normal with charac- 
teristics 


Hence 





1 
4 
P= \ f (x, | Xy = 0) dx = 20 ( 0.776 =: 0.81, 
—1 
9.80, The input of an oscillatory unit of an aufomatic control system, 
Whose transfer function has the form 


D (p) = ki(Tp? + Ep +k) (§ > 9), 


picks up white noise with spectral density Sx; (w) = WN. Find the 
vaniance of the output signal (we speak of sufficiently distant time- 
Intervals after the termination of transient processes). 

Solution. 


Sy (@) = Sz (w) | (iw) |? = NAM T (io)? + Sia + & P), 


Whence 
Vary= | 5} (0) do=nkN IE, 
Note that the variance of the output signal does not depend on the 


rer Constant T of the oscillatory unit, but depends only on the amplifi- 
lon factor k, the damping factor & and the power of the signal NV. 
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9,.8f. The transfer function of a system to which a signal X (£) 1s sent 
has the form 


@ (p) = (1 + Typ)(Tip* + p + Ry}, 


where k = 25— and T, =0055 
The spectral density of the input signal 


St fo) = 276/11 + (To)), 
where T = 1s, and §, = 4 dep*/s* Vind the variance of the output 


signal 
Solution. 
S$ (w) = $3 (w) [PD (10) |? = 25. (—T? (to)? 4) 


(TT, (op -F +7) Gay GLA) topey 


Var, = | $3 (0) da 
0 


1 ff by (tw)#-+-b; (ta)?-+-8, 


= Be} Ta, Co}? fa, (o})-Fa, to-Pa,[ 


_ — yb) ag), — pt ba/tty 
25 (dys -— 214) 


in this caseb, = 0, 6 = —T}, b= 1, a9 = TT, a, = T+ fi 
a, = 1 + kf, dg =k Then 


_ O,—aybe/dy 
Vary = 4nP6, twee. me 0 0428 deg? 


9 82 The output signal Y (t) 1s related to the input signal X {#) by 
the differential equation 


dx 
ay) 4 ayX (1) = b, EO + ay (2) (9 82) 


The stationary random function X (f) 1s normal with characteristics 
m, and A, (t) = Var, e-@Itl Find the characteristics of the output 
signal Y (2) 

Solution. Since the random function X (£) 18 subjected to a stationary 
linear transformation, the random function Y (£) 1s stationary in the 
steady state condition The variable m, can be found from the equation 


Sinte Mm, = tonst and m, = const 1% Follows that ag, = behys 


whence m, = aym,/by Equation {9 82) can be written 1n an operator 
form, 1e, 


(4p + a9) X (t) = (ip + bo) Y (, 
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whence 
Y (t) = PEE X (t) =O (p) X (2), 


where @ (p) is a transfer function. 








S5 (0) = Sz (0) |® (io) |? = Sz (0) | Boe 
_ Varx & 1 aj+-a?w*® Varxa@ 4 az + a2w? 
aw? BR bRw? be Fw? OR /b?-++- w? * 


We can rewrite the expression for Sj, (@) in the form 
_ Vary & az +t-azw* _ Vary & a c 

(0) expenmstey ~ an (par bapa): 
where 

ag — azdp/bt 

a2—b2/b? ’ 

We designate D, = Var, aa/b, Dz = Var, ac/(bjd). Then (see item 6 
of Appendix 7) R, (t) = D,e~>'*! Dazed ltl, The variance of the output 
signal Var, = R, (0) = D, + Deo. . 

9.83. An RC-filter is used to lower the level of noise X (£) (Fig. 9.88). 
The filter picks up stationary white noise with spectral density Sz (@) = 


: 
X(t} C : Y(t) 


Fig. 9.83 Fig. 9.84 


b=, d = bolb;. 


a=ai—c, c= 





10-5 V2s, Find the least time constant 7 = RC of the filter for which 
= eis — will exceed 100 mV in absolute value with probability 
= UNO lf m, = 0. 


Solution. The transfer function of the RC-filter has the form @ (p) = 
1 + Tp). Consequently, 





53 (0) =| | * fq) ——_-__4g-5 — Yaty% _ 1 
y (a) ipfio | °=() = Gap 10° =, eto ? 


Where % = 1/T A/s, Var, = na X 10-° V*. Hence (see item 5 in Ap- 
pendix 7) R, (t) = Var, e7%!T1, 


Pea the normal input signal is subjected to a linear transformation, 
tae da Signal is also normal with characteristics m, = 0, Var, = 
in {0-5 Ve. By the hypothesis P= 1 — 20 (100/c,) = 0.05, where 


me is the error function (Appendix 5). We have @ (100/c,) = 0.475, 
= 1.96, o, = 100/1.96 = 51.1 mV, o? = Var, = 26.1 x 4 V2. 
te smallest time constant J = (at/Var,) 10-5 = 0.012 s. 

210575 
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9.84. The input of the #C-filter shown in Fig 9 84 picks up a normal 
stationary random function A (t) with characteristics m,, A, (t} = 
Var, cos fit Find the characteristics of the output signal Y (f) 

Solution The transfer function of the filter has the form @ (p} = 
Tp (1 + Tp), where T = RC Consequently, m, = 0 (the constant 
component does not pass through the capacitor C) The spectral density 
of the output signal (see item 3 of Appendix 7) has the form 


a Tr * 7 
$3 (0) =|—79 5 |’ $2 (0) = Saha Vere (8 (@  B)-+0(o—B)I 


We can find the variance Var, of the output signal from the expression 
(see Appendix 6} 
Vary = \ S} (a) do 
2 {7B} 


Vary ¢ (Toy? 
=e | aha (0+ f) +5 (of) do= Var, ae 





The univariate distribution of the output signal is normal with param 
eters m, = 0 and Var, 

9.85 The input of an automatic voltage regulator receives a voltage 
A {t) which 1s a normal stationary stochastic process with characteris 
tics my, = 220 Vo RA, (t) = Var, e7@stt(d +a [tt t}, where Var, = 
o3== 16 V*, 7=2001/s The voltage regulator operates normally 1f the 
voltage X (t) 1s no lower than 208 V and no higher than 232 V, otherwise 
It automatically switches off and switches on egain when the input 
voltage X (t) returns to the indicated range Find the probaliltty Pp 
that the regulator will be operating at an arbitrary moment {, the 
distribution of the duration of the normal operation 7’, and the average 
duration of the period t, when the operator 1s switched off 

Solution In accordance with the solution of Problem 9 70 (8), 


aa 
fy (1) = — ap [Var e- el (1 - @ [t]}} 
= Var, ae lth(1—-a |t}), o, =a0,. 
The average number of times the level @ ts crossed 18 
1. {a—m,)" Oy 
hy {exp] — = |} St = 0 354 1/s 


Consequently, the total average number of times it crosses 
the permissible level in unit time 1s 24, = A, = 0708 i/s For all 
practical applications we can consider the distribution of the random 
variable 7, to he exponentia) with expectation tf = 1/A, = 1415 
The probability that the regulator will be operating at an arbitrary 
moment 15 


p = P (208 < X(t) << 232) = P(| X ) — mz |< 12) = 2@ (3) = 0 9978 
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On the other hand, we can find the probability p from the expression 
p=4/(t, + t,), whence tg = t, (1 — p)/p = 1.34 x 10 s. 

9.86. A radio device can function only in a certain temperature 
range t, -+ 30 °C, where ¢, is the average rated temperature. When the 
temperature passes either limit, the device fails. The ambient tem- 
perature X (¢) is astationary random function with mean value m,. = ty 
and mean square deviation o, = 10 °C, and with a correlation function 
of the form #.,, (t) = 100 (sin t)/t °C*; the distribution is normal. Find 
the average number of times the temperature crosses the levels t, + 30°C 
during a time period 7 = 50s. Assuming the number of level crossings 
to have a Poisson distribution, find the probability that the device 
will fail during the time 7. 

Solution. According to the solution of Problem 9.72 


Okey (T) 4 T 
Ry (t)= — —ja = — 100 {— ++ 55—- ee }. 


Setting t = 0, we find Var, = R, (0) = 33.3, 6, = 5.76 °C, According 
to formula (9.0.42), the average number of times the level @ = m, +- 
30°C is crossed upwards is 


he = — e-27/200 SY — 0.004134 4/s 
2H Ox 


The average number of downward crossings of my = —30 °C is the same, 
hence the total average number of times the permissible limits are 
crossed is 2A, = 0.00269. 

_ For the random variable Y, which is the number of times the level 
iS Crossed and which has a Poisson distribution with mean value 21,7 = 
0.00269 x 50 = 0.1345, the probability that it exceeds zero (at least 
one level crossing occurs) is 1 ~ e~°-1945 = 0.425. 


CHAPTLR 10 


Flows of Events. 
Markov Stochastic Processes 


100 A flow of events is a sequence of homogeneous events occurring one alter 
another at random moments Cximples are a flow of requests at a telephone et 
change the goals scored during an ice hockey game the occurrence of faults during 
the operation cf a computer the job requests at a compuime centre and so on 

A flow of events can be depicted by 4 series Of points with abscisgas 8, 9, 

8, (Fie 1001) with intervals 7, = 6, — 6, T, = 0;~ 0, 
Yr, = 6.4, — 9, In probability theory a flow of events can he represented as 
a sequence of random variables @, ©, = 8, + fT, 6,;=—86,+ 7,3 T: 

Note that the term event in the concept ‘flow of events differs in sense from 

the term ‘random event which we introduced earlier It 1s senseless to speak of 


fy, I; T. try 
pom ne ; niin’ phe £ 
é af D> G; o, fl | Cy Ost 
Cig 1001 


the probability of events ima flow (say the probability of a request” at 1 telephone 
exchange since sooner or Jiter a request will arrive and not just one A flow of 
events can he associated with viriotts random events for mstance 


A = {at least one request will armve during the interval 
from f) io fy + +} 


oT 
&= {two requests will armve during the same interval} 


The probabilities of these events can be calculated 

It must be pouated cut that se can depict as a series of posnts not a ow of 
events itself (it 19 acctdental) but tts certain specific realisation 

We mentioned in Chapter 4 flows of events and some of their properties but 
we shall now consider them here :n more detail A flow of events 15 stationary ul 
the probability characteristics do not depend on the choice of a reference pont or 
more specifically if the probability that a particular number of events will fall on 
any tune interval depends only on the length t of the interval and does not depend 
on its place on the ¢ axis 

A flow of events 1s sand to be ordinary if the probability that two or more events 
may fall in an elementary time interval At is negligibly smail as compared to the 
probability that one event may fall on that unterval The ordinariness of a flow 
Mean» that events m if occur one at a time and not in groups of two three elc 
(that two events May occur simultaneously ig theoretically possible but has zero 
probability 

An ordinary dow of events can be interpreted as a stochastic process X (f} 1¢ 
the number of events that occurred up to the moment z¢ (Fig {@ 02} The stechashe 
process A (f} increases Jumpwise by unity at the points 8, ©, n 

A flow of events 1s known as 4 flow without an aftereffect 1f the number of events 
falling on any tzme interval + does not depend on how many events fell on any 
other nonoverlapping imterval In essence the ahsence of an aftereiiect in 4 flow 
means that the events which form the flow oceur at certain moments independently 
of cne another 
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A flow of events is said to be elementary if it is stationary, ordinary and has no 
aftereffects. 

The interval of time T between two successive events in an elementary flow has 
an exponential distribution 


f (0) = Ae! (for t > 0), (10.0.4) 
where 2. == 1/M [7] is an inverse of the mean value of the interval 7. 


An ordinary flow of events without an aftereffect is a Poisson flow. An element- 
ary flow is a special case of a Poisson flow (namely, a stationary Poisson flow). 


X(t) — 





Fig. 10.0.2 


The intensity A of a flow of events is the mean number (expectation of the number) 
of events per unit time. For a stationary flow 4 = const; while for a nonstationary 
flow the intensity is generally a function of time; ’ = A (é). 

The instantaneous intensity of a flow A (é) is defined as the limit of the ratio 
of the mean number of events which occurred during an elementary time interval 
(t, ¢-+ At) to the length Az of the interval, as the length tends to zero, The mean 





number of events occurring during the time interval t immediately following the 
to+T 


moment to (see Fig. 10.0.1) is a (t), T) = \ X(t) dt. If the flow of events is sta- 


tionary = a, . 
ary, then a (tp, t) = a (t) = At. 
An ordinary flow of events isa Palm flow (or recurrent flow, or a flow with a lim- 
ited aftereffect) if the time intervals T1, To, ... between successive events 
ste Fig. 10.0.4) are independent similarly distributed random variables. Because 
2 the similarity of distributions T7,, Ty, ... a Palm flow is always stationary. 
on elementary flow is a special case of a Palm flow; the intervals of the events in 
It have an exponential distribution (10.0.1), where 4 is the intensity of the flow. 
ie ane ng s flow of order k is a flow of events which results when an elementary flow 
hee lnned out”, i.e. when every kth point vent) in the flow is retained and all 
in intermediate points are removed (see Fig. 10.0.3, where it is shown how Erlang’s 
urth-order flow is obtained from an elementary flow). 
pom Erlang s flow of order & the time interval between two adjacent events is the 
tial of k independent random variables 7,, Ts, ..., 7; which have an exponen- 
distribution with parameter 2: 


R 
T= >) 1). (40.0.2) 
j= 
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The distribution of the random ywarlable 7 19 known as an FEriang distribution 
of order & (see Problem § 38) and has a density 
A CAL An 
i,ij= Ah 


ee at (for t>> 0), (40.0 9) 


The mean yalue, vatiance and mean square deviation of the random variable f 
(10 0 2) are 


my oz kik, Vary = kM, of = V RIK (40.0 4 
respectively The coefficient of variation of the random yariable {i0 0 2) 13 
by = o/s, = t/Vk, (10 05) 


hence »;j + 0 as k-~-» co ie when the order of Erlang’s flow increases, “the degres 
of randomness’ of the interyal between the events tends to zero 





& tts, 
ts (the present ) é 
Ing 1004 Mg 1005 Fig. 1006 


If, slong with thinning out’ of an elementary flow, we also change the scale 
along the ¢ axis (by dividing by &), we obtain a standardized Erlang Dow of order é 


whose intensity dees not depend on & The tame interval T between successive 
events in a standardized Erlang flow of order & has a denstty 


qn j= een (for t>> 0}, {40 0.6) 


The numerical characterzstics of the random varrable 


Fo+ Vr, 


are 
M|F|=4/4, Var|P|=4/ke@, G=40VR, vimt/VR (1007) 


As k increases the standardized Erlang flow approaches indefinitely a reguia? 
fow with a constant mterval i = 1/2 between the events 

A stochastic process in a physica] system § 1s known as a Afarkov process (or 
a process without an aftereffect) if for any moment t, (Fig 100 4) the probabitity 
of any state of the system in future (for t > 2,) depends only on ifs state tn the present 
{for 2 = t)} and dues not depend on when and hou the system S reached that state Ke 
otber words for a fixed present the future does not depend on the pre history oj the 
process, 1e on the past) 

In this chapter we shall study only Markov processes with discrete states 4 
f.  . 4S, Itisconvenient to illustrate this kind of process by means of a directed 
graph of states (Fig 100 5}, where rectangles (or circles) denote the states %, 2 + ° 
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of system S, and the arrows denote possible transitions from one state to another 
(only the direct transitions are marked and not passages through other states). 
Sometimes the possible delays in a state are also marked on a directed graph using 
an arrow (“loop”) directed from the state into itself (Fig. 10.0.6), but this represen- 
aay can be omitted. A system may have a finite or infinite (but countable) num- 
er of states. 

A Markov process with discrete states and discrete time is usually called a Mar- 
kov chain. For such a process it is convenient to consider the moments ¢,, ty, .. . 
when the system S can change its state as successive steps in the process, and to 






[ 


Fig. 10.0.7 


consider the ordinal number of a step 1, 2, ..., *, ... rather than time ¢, to 
he the argument on which the process depends. In that case the stochastic process 
is characterized by a sequence of states 


S (0), S (4), 5 (2), 2. +, S(k), . 0s, (10.0.8) 


where S (0) is the initial state of the system (before the first step), S (1) is the state 
of the system immediately after the first step, ..., S (x) is the state of the system 
Mmediately' after the kth step... . 

The event {S (k) = s;} = {the system is in state s; immediately after the kth 
step} (i= 1, 2, ...) is a random event and, therefore, the sequence of states 
(10.0.8) can be regarded as a sequence of random events. The initial state S (0) 
may be either assigned or accidental. The events of sequence (10.0.8) are said to 
form a Markov chain. 

Let us consider a process with n possible states s,, So, ...; s,. If we designate 
as X (t) the number of the state in which the system S is at a moment ¢, then the 
Process (Markov chain) can be described by an integral-valued random function 
X (t) > 0, whose possible values are 1, 2, --., ”. This function jumps from one 
integral value to another at given moments t,, t,, ... and is continuous on the 
eft, as depicted by the points in Fig. 10.0.7. 

F Let us consider a univariate distribution of the random function X (tf). We 
coe as p; (k) the probability that the system S will be in the state s; (i= 
»2,..., n) after the Ath step {and before the (& -++ 1)th step). The probabili- 


ne pi (kK) are called the probabilities of the states of a Markov chain. It is evident 
that for any k 


Dy pi lk)=4. (10.0.9) 


=} 
The Probability distribution of the states at the beginning of the process 
py (0), Pg (0), ..-. pz (0), ~~, Pn (0) (10.0.140) 
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ig known as the initial probability distribution of the Markov chain In particular 
if the exact initial state S (0) of system & is known say, 5 (0) = 3,, then the mital 
probability p, (05 = 4 and all the other initial probabrlitres are zero 

Tho probability of transition at the kth step from the state s; to a state s; 18 the 
condttional probability that the system 5S will be in the state s, after the Ath step 


provided that immediately before this (after kK — f steps} 1t was in the state x 
A Markov chain is said to be Aomogeneous if the transition probabilitzes do 


not depend on the ordinal number of the step and only depend on the steps from 
which and to which the system passes 


The transition probabilities /,,; of a homogeneous Markov chain form ann X a 
square matrix called a trans:itron matrix 


Puy Pig Pry Pin 
Poi Pos Pay Pen 

| Pail =] p, Pia Py " P,, |I- (10-0 42) 
Pat P rs Prj Pan 


The sum of the transition probabihiies m any row of the mairix 1s equal to unity 


Du Pyyol (r= 1, ov, ithe (10-0 13) 
j=1 


A matrix which possesses this property 1s called a stochastic matriz The probalility 
P,)18 the probability that a system which 1s in the state s; before a given step wii 
remain in that state at a next step 

If the initial probability distribution (10010) and the matn of transition 
probabilities (10 4 12) are given for a homogeneous Markoy chain, then the prob 
abilities of the states of the system p, (&) (i == 4, 2, . ») can be found from 
the recursion formula 


ptkh= >) py(k—-1)Py, (-i, , aft, «yn (10044) 
J=1 


For an inhomogeneous Markov chain the transition probabilities um matrix 
(f0 0 12) and formula ({0 0 14) depend on the ordinal number of the step & 

In actual calculations using formula (10 0 14) not all the states s; need be taken 
into account but only those for which the transition probabilities are nonzero, 1 
those from which arrows lead to the state s, on the directed graph of states 

A Markov process with discrete states and contmuous time is sometimes called 
& continuous Markov chain For such a process the probability of transition from 
4 state s; to a State s;13 zero for any moment Jn that case, stead of the transition 
probability Pa we cOnsider the transition probabtliy density Ay; which 1s defined 
ag the limit of the ratio of the probainbiy of transition from the state s, ta t 
state s; during a small time interval At after a moment ? to the length of that inter- 
val as'it tends to zero The transition probability density can be esther constant 
(Agy = const) or dependent on trma [A p= hy (1) In the first case a Markoy sto- 
chastic process with discrete states and continuots time 1s said to be homogenesus 
A stochastic process XY (t}, which 1s the number of events in an elementa low 
occurring before tha moment ¢, ts a typical example of such a process (see Fig 10 9 2) 

When considering stochastic processes with discrete states and contipwous 
time, rt 1s convenrent to assume that the transztrons of a system § from state te 
state are affected by some flows of events In that case the densities of tranailiod 
probabilities assume the meaning of intensities Az, of the corresponding flow 9 
eventa (aa soon as the first event occurs jn the fow with intensity 4,;, the system 
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jumps from state s; to state s;). If they are all Poisson flows (i.e. ordinary and without 
aftereffects, with the intensity being constant or dependent on time), the process- 
in the system S becomes Markovian. 

When considering Markov stochastic processes with discrete states and contin- 
uous time, it is convenient to use a directed graph of states on which the intensity 
};; of the flow of events which shifts the system along a given arrow is marked he- 
fore each arrow (Fig. 10.0.8). This type of 
directed graph is known as a marked graph.*) 

The probability that the system S which 
is ina state s;, will pass to a state s; during 
an elementary time interval (¢, ¢ ~> dt) 
pe element of the probability of transition 
Tom s; to s;) is the probability that during 
the time di at'least one event in the flow 
which shifts S from s; to s; will occur. With 
an accuracy to infinitesimals of higher orders 
this alent is A;; dt. 

The flow of the it Pani eo of oe 
irom s; tos; is a quantity A;;p; (¢) (here the . 

intensity ve may either be dependent on Fig. 10.0.8 

or independent of time). 

Let us consider the case when the system S has a finite number of states 5, 
53, ..., S,. To describe a process in the system, we use the probabilities of states: 





Py (t)) Po (fs » + +) Pn ()s (10.0.45). 
Where p; (t) is the probability that at a moment ¢ the system S is inlthe state s;: 
p; (t) = P {S‘() = s;}-. (10.0.16); 
Evidently, for any ¢ 
S pi (j= 1. (10.0.17)- 
i=1 


_ (To find the probabilities (10.0.15), we must solve a system of differential equa- 
lions (Kolmogorov’s equations) which have the form 


Th Th 
dpi (t) 
fe DS) Apps ()—pi lt) Dy ig (C= AEZ, «0, 


T, omitting the argument ¢ of the variables p;, 


7 n 
dp; , 
ar = 2» Agipd~—Pi Dy Pag (== 4, 2,-0.4), (10.0.18) 
pe j= 


Remember that the intensities of flows 4;; may depend on time ¢ (to make the- 
Dotation briefer, we have omitted the argument 2). 
of i iS Convenient to derive equations (10.0.18) using a marked graph of states. 
: Ne system and the following mnemonical rule: the derivative of the probability 
iu ooo State is equal to the sum of all the probability flows which pass from other states 
: ve fiven state minus the sum of all the probability flows which pass from the given 
ate to other states. For example, for the system S whose marked graph of states 


eer nes 


wre shall not draw loops corresponding to delays of the system in a given 
“ate in the directed graph of states since a delay is always possible. 
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d3 given in Fig 1008 the Kolmogorov s equations are 
dp,/dt = Agpy + AaPa — Qas + Aya) Pus 
dpa/dt = dyepy —— haypy 
dpgldt = Agsps — (Ag, + Ag, Ags) Dy (10.0 48 
dpyidt = Ayapy + Agipg + AsaPs — Aa Py 
dpidt = Agsp, — AgaPs 


since condition {10 0 17} is satished for any ¢ we can éxpress any one of thi 


probabilities ({0 0 15) in terms of the other probabilities and thus dimuintsh thi 
number of equations by one 


To solve the system of differential equations (10 0 18) for the probabilities o 
states py (1) ps (b Py (¢} we must specify the inttial probability distributior 
Py (0) pg (0) » Py (8) + Pr (9), (10 0 20 

whose sum is equal to unity 


“ 
>» 4 (0)=1 
j=1 


If ina special case the state of the system 5 at the initial moment ¢ = 0 1: 
éxactly known S$ {0} = s; then p; (0}= 41 and the other initial probahilitie: 
{10 0 20) are zero 

In many casey when the process in a system 1s sufficiently long the limiting 
behaviour of the Probabilities p, (¢) as t+co becomes of anterest If all the flows 





Fig 1009 Fig 109 10 


of events which shift « system from state to state are elementary (1 e stationary 


G1830B processes with constant mtensities Az;) then limiting probabilities of 
states are possible, 


Pr= lim p (tf) (t=14 7) (10 0 21) 
fron 


which do not depend on the State in which the system was at the initial momen! 
Thia means that 1n the course of timaa i imiting stationary condition 1s established in 
the system The system still Passes irom state to state but the probabilities of the 
étates no longer change In this limiting condition each of the limiting probabilities 
can be interpreted as the relative mean time for which the system stays in a given 
state 

A system for which the limiting probabilities exist is known as an ergodig ays 
tem and the corresponding stochastic process aa an ergodic protesg 

The condition Agj== const alone 19 insufficient for the existence of Limiting prob 
abilities and othar conditions must be fulfilled which can be verified from the 
graph of states by isolating essential and imessential states in it The state s; 
as essentia? 1f there tg no state fy such that having once paased fram s,; to s; tn some 
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way, the system cannot return to s;. Every state which does not possess this pro- 
perty is inessential. . 

For example, for a system 5S, whose directed graph of states is shown in 
Fig. 10.0.3, the states s,, S, are inessential (the system can leave state s,, say, for sp 
and not return, and leave s, for s, or s, and not return), whereas states s4, ss, s, 
and s, are essential. 

For a finite number of states n, for limiting probabilities to exist, it is necessary 
and sufficient that it should be possible to pass from each essential state (in a certain 
number of steps) to every other essential state. The 
graph shown in Fig. 10.0.9 does not satisfy this 
condition (for instance it is impossible to pass from 
the essential state s, to the essential state sz). 
Limiting probabilities do exist for the graph 
shown in Fig. 10.0.40 (it is possible to pass from 
every essential state to every other essential state). 

Inessential states are thus called because sooner 
or later the system will leave these states for one 
of the essential states and will not return. The 
limiting probabilities for inessential states are 
naturally zero. 

If a system S has a finite number of states 
41, S,'..., $,, then, for the limiting probabilities 
to exist, it is sufficient that the system could pass 
from any state to some other state in a certain number 
of steps. Jf the number of states 51, 59, ++ +; Sp. y+ 
isinfinite, then this condition is no longer suf- 
ficient, and the existence of limiting probabilities Fis, 10.0.41 
depends both on the directed graph of states and 2 
6n the intensities Aj. 
_ whe limiting probabilities of states (provided they exist) can be obtained by solv- 
Ng a system of algebraic linear equations which result from the Chapman-Kolmo- 
sorov differential equations if their left-hand sides (derivatives) are set zero. But 
it is More convenient to derive these equations directly from the directed graph 
Of states using the mnemonical rule: for every state the total outgoing flow of proba- 





Q Ay ho Ayes Ax n-f 
Es las ecto fom Netto 
Hy ft ft ttt ke] # 


Fig. 10.0.12 


Dilities is equal to the total incoming flow. For example, for a system S, whose directed 
marked graph of states is shown in Fig. 10.0.11, the equations for the limiting 
Probabilities of states have the form 


Aro + Ais) py >= NorP 2: (Ao + has) Do= AyoPs se AsoPa. 
(A (10.0.22) 
31 Ags) Ps = AqsPy, AgaDg = AogDe 1 AgsPs 1 AssPs) AsaPs = AasPs 


b Thus, for a system S with n states, we obtain a system of x homogeneous alge- 
Taic linear equations in n unknowns Pir Par «++: Dye Lhis system will yield the un- 
a OWNS py, Pa, . 2s, p, {with an accuracy to within an arbitrary factor. To find 

© exact values of py, .. -; Pay We must add to the equations the normalizing con- 
: ition es gee n = 1. We can then express each of the probabilities p; 
0 terms of the other probabilities (and correspondingly delete one of the equations). 
win practical applications we often encounter systems whose directed graphs of 
2 ae ave the form shown in Fig. 10.0.2 (all the states can be extended to form 
ae din, each state being in a relation, both forward and backward, with the two 

Jacent states except for the two extreme states, which have only one neighbour). 
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The chain shown on Fig 10042 15 known as the dirth and death process There 
terms have been borrowed irom biological problems where the state of a popula 
tion s, signifies the presence of & unita in it A transition to the right 13 connected 
with the birth” of umts and that to the left with their “death” In Fig 10012 
the birth rates (Ay ?, An +) are put beside the arrows leading [rom left 
torght andthe death rates” (pt, p, i, ,) are put beside the arrows leading 
from right to left each of them has an index of the state from which the correspond 
ing arrow leads 

For a birth and death process the limiting probabilities cf states are evpre aed 
by the formulas 


y=— Fo pratt p 
=A" L py (k= 0 yr) gs 
Pe 
py frrce pay 4p Rot te" (19025 


Pay attention to the rule of caleulating the probability of a state (for 4 = 
R} 


_ Andy Manet 
Pee OR 


which can be formulated as follows the probabiitty of a state in a birth and death 
process (ge0 Fig 100 42) is the product of afl the btrih rates to the left of s, divided by 
the product of ail the death rates to the left of s, the fraction being multiplied by Live 
provability of ihe ext eme left sfate p 

If a process 39 described by the birth and death chain we can write differential 
equations for the Mean value and variance of the function X (t) 1 e for the number 
of unita im the system at a moment ¢ 


Po 


A 
et 2: (An — Ha) Pp it) (10 0 24) 
A=0 
(d Var it i 
ci => [Ant } Rb2k {An — ip) — 2m, (tf) (Ap <— Ux)] PR (f) {10 0 25} 
A—O 


In these jormulas we must set A, = p, = & The intensities A, (0S Aq 1} 
and te (i <. & <n) can be any nonnegative functions of time 
When the values of m. (é) are sufficiently large (220) and the condition 0 < 


m, (f) +3) Vary (t) <n 1s satished we can approximately assume that the 
section of the random function X (t} 13 a normal random variable with parameters 


ty (t) ¥ Var,(2) which were obtained by solving equations ({@ 0 24) and {t0 0 25) 
Formulas (10 0 24) and (40 0 25) remain valid as n -> oo if the upper limit 19 the 
sums 13 replaced by oa 


Problems and Exercises 


104 Two elementary flows are superimposed flow I with In 
tensity 4, and flow IF with intensity 4, (Fig 101) Is flow Iti 
resulting from the superposition elementary and if uo is, whet 1s ifs 
intensity ? 
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Solution. Yes, it is since the properties of stationarity, ordinariness 
and absence of an aftereffect are conserved; the intensity of flow III] 
is equal to Ay + Ad. 

{0.2. An elementary flow of events with intensity 4 is thinned out 
at random. Each event, independently of the other events, may be 


ar, fof l ' 
} | | 

| | | | | | : 
7 | | | 
OY | 1 | | | My | 
poet, | opty th tag bY 
a a oe | a ee a 

m+ , , t 


Fig. 10.1 


conserved in the flow with probability p or removed with probability 
1— py (in what follows we shall call this operation the p-transfor- 
mation). What is the flow resulting from the p-transformation of an 
elementary flow? 

Solution. The flow is elementary with intensity Ap. Indeed, under a 
p-transformation all the properties of an elementary flow (stationarity, 
ordinariness, absence of an after- 
effect) are conserved and the intensity F{t) 

Is multiplied by p. At--—-— 

10.3. The time interval 7 be- 
lween events in an ordinary flow 
has a density 


[ Ae~Mi~ to) for t> tp, 





f(t 
| 0 for t<fp- z 
(10.3) 7 tp 
The intervals between the events Fig. 10.3 


are independent. (1) Construct a 
gtaph of the probability density f (t). (2) Is the flow elementary? 


(3) Is it a Palm flow? (4) What is its intensity r? (5) What is the variation 
Coefficient v; of the interval belween the events? 

Solution. (1) See Fig. 10.3. We call a distribution of this kind “ex po- 
told displaced by tf)”. (2) No, it is not, since distribution (10.3) is 
ot exponential. (3) Yes, it is, because of the ordinariness of the flow, 


the independence of the intervals and their similar distribution. 


@)2= UMIT] MIT] <1. +t, i= (1/0 + to)? = AMA + fp). 


(5) Var T — 1 ae nL een. ae Oe 
WSs, Gea =a {7h-+t, 140,” 
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1) 4 There is 1n elementary flow of events with intensity 4 on the 
taxis Another flow 1s formed from tt by inserting another event at the 
midpoints of the interval between every two adjacent events {see 
Fig 104 where the circles denote the princtpal events and the crosses 
denote the inserted ones) Find the distribution density f (i) of the 


OK on P—-—SHis co e— fF 
i? 


Tig i104 


interval 7 between adjacent cvents in the new flow Is the flow elemen 
tary? Isita Palm flow? What is the cocfficaent of variation of the inter 
val J between the events? 

Solution J — A/2 where X has an exponential distribution with 
parameter A fy (zt) = Ae 4* (x >> 0) Using the solution of Problem 8 1 
and setting a@ = 1/2 6 = 0 in formula (8 1) we obtain 


f(t)=2ake-2t (>> 0) (10 4) 


This 1s an exponential distribution with a coefficient of variation 
v,— 1 Nevertheless the new flow 1s not elementary nor even a Palm 
flow Ve shall first prove that 1t is not a Palm flow Though the in 
tervals between the events have the same distribution (10 4) they are 
not independent Let us consider tno adjacent intervals They may 
be independent with probability 1/2 or equal to one another with prob 
ability 1/2 and consequently dependent Thus the new flow of events 
ts not a Palm flow It 1s naturally not elementary since an elementary 

flow is a special case of a Palm flow 

At X sj Thus an exponential distribution of 

an interval between events 1s not a 

é sufficient condition for a flow to he 

elementary 

Fig 105 105 The hypothesis 1s the same as 10 

Problem 104 except that the new flow 

consists only of crosses (the midpoints of the intervajs) ? Answer 
the same questions as in the preceding problem 

Solution The intensity of the new flow will not evidently change 35 
compared to the intensity of the original flow and will remain equa! to 
4 The interval between two neighbouring crosses (Fig 40 9) 1s 


P(X, + X444)/2, (10 9) 


where X; and X,,, are two adjacent intervals in the original flow The 
variables X, and Aza, both have an exponential distribution with 
parameter A and half their sum (10 5) will have a standardized Erlang 
distribution of the 2nd order since the interval 7 1s equal to the sum 
of two independent exponentially distributed random variables divided 
by two Thus the interval 7 between two crosses has a density f (4) = 
4Méta~2ht (t > 0) 


TT 
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In the transformed flow all the neighbouring intervals are dependent 
since their components are the same random variables. However, this 
dependence involves only neighbouring intervals. Flows of this kind 
are sometimes called flows with a weak aftereffect. 

The coefficient of variation v, for the random variable 7 is [see 


formula (10.0.7)] v, = 1/V2< 14. 

10.6. The traffic on a road in the same direction is an elementary flow 
with intensity 4. A certain Petrov stands on the road and tries to stop 
acar. Find the distribution of time 7 for which he will have to wait, 
its mean value m, and mean square deviation 0,. 

Solution. Since an elementary flow has no aftereffects, the “future” 
does not depend on the “past”, in particular on the time when the last 
car passed. The distribution of time 7 is the same as the distribution 
of the time intervals between successive cars, i.e. exponential with 
parameter A: f (t) = Ae~** (>> 0), hence m, = 4/A, Var, = 4/A*, 
7. = 11. = Mi, Dy = 4. 


Remark, If the traffic on a highway is in more than one lane, it can be consid-- 
ered to be a superposition of several flows, each corresponding to one lane. If each 
low is elementary, then the result of the superposition is also an elementary flow 
since the properties of stationarity, ordinariness and absence of an aftereffect are 
conserved under a superposition (see Problem 10.1). 


10.7. A passenger arrives at a bus stop irrespective of the time-table. 
The buses arrive regularly with an interval J. Find the distribution of 
lime 7 for which the passenger will have to wait for a bus and express. 
lis characteristics m, and o; in terms of the intensity of the traffic i. 

Solution. The moment the passenger arrives at the bus stop is dis- 
tributed with a constant density within the interval 2 between two- 
buses. The distribution density of the waiting time 7 is also constant 
la uniform distribution on the interval O,o0:fo@™@=1O<mi< Dd, 
or, designating 1/1 = 4, f (t) =A (O<c.t< 4/A). For a uniform dis- 
tribution on an interval of length 1/4 we have m, = 1/(2A), Varj= 
Li(12A"), o, = 1/(2 V 3d), v, = 1/73. 

{0.8*. There is a Palm flow of events on the ft-axis, the intervals 
between which are distributed with density f (é). A point ¢* is thrown 


° een Pe kale 
t Se —_ a z 


Fig. 10.8 


at random on the t-axis (say, an “inspector” arrives to verify the occur- 
‘ence of events, or a “passenger” arrives at a bus stop), the moment ¢* 
cing in no way connected with the occurrence of the events in the flow: 
(Fig, 10.8). Find the distribution density of the interval T* on which: 


ic point f* has fallen, its mean value, variance and mean square. 
CViation. 
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Solution it seems at first sight thit this density 1s the same as the 
distribution density f (2) of any interval 7 between the events It 15 
not, however the case That a point {* thrown at random has fallen 
on the interval 7* changes its distribution Indeed, if there are a 
variety of intervals (large and small) on the ¢ axis, then there is a 
greater probability that the pornt ¢* will fall on the larger interval 

Let us find the distribution density /* (¢) of the interval 7* on which 
the point ¢* has fallen We seek the element of probability f* (é) di 
equal to the probability that the point ¢* will fall on the interval whose 
length is in the range (¢ ¢ + df) This probability 1s approximately 
equal to the ratio of the total length of all such intervals within a very 
large interval of time 9 to the total length of that interval 

Assume that a large number A’ of intervals between the events fit 
an a very large interval @ The average number of intervals, whose 
length is in the range (£ f + dt) is Nf (t} dt, the average total length 
of all such intervals is approximately ¢tN/ (¢} dt The average total 
length of all the ¥V intervals Q 1s (approximately) Nm,, where m, = 


M [7] = \ if (t) dé Dividing one by the other, we get 
p 
‘ ~, vif (d) dt _ tf tty 
} (t) db ae = . dt 


TL 
The approximation becomes the more exact the longer the interval 
of time © we consider (the largor V) In the limit, the distribution of 
fhe random variable 7'* 1s 


{* (t) = ——— f(t) (t > 0) (10 8) 


MIT] = [> | Pf (t) de= 4a, (t) = L-(Vart-mt), 
0 


Var {7*] = ay (7*] —(M [T4])? = —— \ taf (t) dt (A (T*]}? 
109 On the hypothesis of Problem 10 3 Palm's flow 1s an elemen- 
tary flow with intensity A 16 7 (t) = he Mt (t >> 0) Find the distri 
bution density /*(2) of the interval 7* 


r* on which the point z* Marae | 

nn 8 
af Sy eT Solution Since m,; = T/A, lormula 
a z* (10 8) yields f* (t} == te“ (t > 0), 


which is none other than £rlangs 
Fig 10 16 distribution of the 2nd order [see for 
mula (10 6 3) for & = 2] 

10 10*, There is a Palm flow of events with density f {t) of the inter- 
val T between successive events on the faxis A random point } 
{an ‘inspector’ } falls somewhere within the interval T* (Fig 10 10) 
It divides the interval into two subintervals @, from the nearest pre 
vious event to ¢*, and HW from t* to the nearest successive event Fin 
the distributions of the two intervals 
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Solution. Let the random variable 7* assume a value s: 7* = s, and 
find the conditional distribution of the interval Q@ under this con- 
dition. We designate its density as fg (¢ | s). Since the point ¢* is thrown 
on the f-axis at random (irrespective of the events of the flow), it evi- 
dently has a uniform distribution within the interval 7* = s: 


fo(é|js) =1/s for Omi<ts. (10.10.14) 


To find the marginal distribution fg (¢), we must average the density 
(0.10.1) with the “weight” /* (s). Using formula (10.8), we obtain 


f*(s)==- f(s). fa(t)= J fo (tls) f*(s) ds 
0 
Taking into account that fg (f | s) is nonzero only for s > ¢, we can write 


oS co 


fa(t)= | 4-7 (s)ds=— | f(y dt==-1—-F (1, 


Sin¢ 
t t 
Where F (£) is the distribution function of the interval T between the 
events in the Palm flow. 
Thus we have 





fo (t) =— 11—F (2)]. (10. 10.2) 


It is evident that the time interval H = T* — Q has the same dis- 
tribution: 


{ 


WU 





fix (t) = 


10.41. Using the results of the preceding problem, verify the solution 
of Problem 10.6, which we obtained from other considerations. 

Solution. We have f (é) = Ae", F(t) = 1 —e* (t>0), m, = 
lt. By formula (10.10.3) 


fe (@t) =Al1—1 + et] =Ae*>t (€ > 0), 


4€. the solution of Problem 10.6 is correct. 

0.42. A passenger arrives at a bus stop irrespective of the time- 
table. The flow of buses is a Palm flow with intervals uniformly dis- 
tributed in the range from 5 to 10 min. Find (1) the distribution density 
of the Interval during which the passenger arrives; (2) the distribution 
density of time H for which he will have to wait for a bus; (3) the aver- 
age lime he must wait for a bus. 

Solution. We have f (é) = 1/5 for t € (5, 10), m, = 7.5. 
Pay By formula (10.8) /* (t) = ¢/37.5 for ¢ € (5, 10). The graph of 
le density f* (2) is shown in Fig. 10.{2a. 


GO for t<05, 
(2) ro] (¢{—95)/5 for 5<ct<ci0, 
{ for t> 10. 


(1 —F (2). (410.40.3) 
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From this, by formula (10 10 3), we get 
0 for t<0, 
1/75 for QOect <5, 
flO) = (140—2)/3875 for St <= 10, 
0 for t= 10 


The graph of the density fy (¢) 1s shown in Fig [0 126. 


F*(t} fy (t) 
_- 
74 
7 a rn a 
fa) 


Fig 1012 


{5) 


{3) The average waiting time 


id 
my = \ te dt+ {¢ot ate 6 11 mn 
O 5 





{0 £3. We consider Erlang’s flow of order & with a distribution density 
of the interval 7 between events 


——_— ~ 
ey ot Gon 10180 
t 
Fig 1013 Find the distmbution function F; (t) of 


this interval 
Solution We could find the distribution function using the ordi- 
nary formula 


t 


FP, (j= \ f(t) de, 


0 


ve it 4 simpler to find it proceeding from the definition (tj = 
fac? 
We pass to the opposite event and find P{T => 7} We associate the 
origin 0 with one of the events in Erlang’s flow and Jay off two intervals 
to the right of it 7 (the distance to the neit event in Erlangs flow) 
and f<2 T (Fig 10 13) 

For the inequality T >> £ to be satished, 11 1s necessary that less than 
A events in the elementary flow with intensity ? fall on the interv E 
{either 0 or 1, , ork — 1) The probability that m events fail on 


Ch. 10. Flows of Events. Markov Processes _389 


the interval ¢ is 


(At)™ — _ a4 
| | e & 
By the probability addition rule 


k-{ 
™m 
PiT>H= > Hem, 
m= 


whence 


k—1 
F,(t)=im SMP emt a1—R(k—1, At), (10.43.2) 


m=0 


where 1 — R(m, a) is a tabulated function (see Appendix 2). 

10.44%, The flow of computer failures is Erlang’s flow of order k 
with the density (10.43.1) of the interval between the failures (when the 
computer goes down, it is brought back into operation instantaneously). 
An “inspector” arrives at a random moment * and waits for the first 
failure. Find the distribution density of the time A for which he will 
have to wait for a failure and its mean value my. 

Solution. By formula (10.10.3) 


jx (t)=S- Fa (1: 


where F, (t) is given by formula (10.13.2) and m, = k/d. Hence 





k—-1 k~-1i - 
ju (t) = SOP prt tS AR om (> 0). (10.44-1) 
m==0 m=0 


m!| [m! 


We rewrite formula (10.14.41) in the form 


k 
jnQ=+ > Are (t> 0). (10.14.2) 


T=! 
It can be seen from (10.14.2) that the random variable H has a “mixed” 
distribution consisting of A Erlang’s distributions of different orders; 
it has Erlang’s distribution of orders 1, 2,..., A with equal prob- 
ability 4/k:. The mean value of such a random variable can be found 
rom the complete expectation formula 


k 
my=M [H]=—— >) MI# IrI, (40.14.3) 


r=1 


Where M [H |r] is the conditional expectation of the random variable 
provided that it has Erlang’s distribution of the rth order. 


4h 
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From the first formula (10 0 4) we find that MH |r] = r/A, whence 


h 
{ <1 (k-1}4 &t1 
mcm ae ER EE (tO 
-_ 

{0 15* A Palm flow of events with distribution density f (i) for 
the interval between the events 1s subjected to a p transformation (ses 
Problem 10 2} A random variable ¥ 1s the interval between the events 
in the transformed flow Find the mean value and variance of the 
random variable ¥ 

Solution The random varmable VY 1s the sum of 4 random nantber 


of independent random variables (sea Problem 8 63) v=2 T, 


where Y 18 a discrete random variable which has a geometne dts 
tnbution P{Y=m}= pa*-! ({m=1 2, ) gai—p and each of 
the random variables 7, has 1 distribution f (#) 
Then the successive intervals between the events in the p-transformed 
flow are 
Ys 


Y 
Y= Dy i’, Y= py Fy+¥34 


oP Bs 


where the random variables V, V, are disjoint and the tran 
formed flow is a Palm flow In accordance with Problem 8 53, 
Wy =——!, Vary = Vars mi i, 


where 


a 


Hl, \ tf(t)di, Vary= { (f—m,)* f (i) dt 
0 0 


Remark Wecan prove that a multiple p transformation of a Palm flaw results 
in a flow which 1s close to an elementary Low 
1016 Find the distribution of the tnterval 7 between the events 
in a Palm flow if the random variable 7 can be determined from the 
Y 


expression fT = > fT, 1¢@ 15 the sum of a random number of random 


hot 

terms where the random variables T, are independent and have ab 
exponential distribution with pirameter # and the random variable ¥ 
does not depend on them and has a geometric distribution beginning 
with unity p, = P{Y =n} = pe (Oct pci,n=1 

Solution As shown in Problem § 62, the random variable T has an 
exponential distribution with parameter Ap and consequently the 
Palm flow hetng considered is an elementary flow with intensity Ap, 
which results from a p transformation of an elementary flow with . 
tensity 4 This confirms the correctness of the solution of Problem 10 
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10.17. The flow of buses arriving at a bus stop is a Palm flow, and 
the interval 7 between each two buses has a distribution density /,(¢). 
A bus stays at the stop for a nonrandom time t. A passenger arrives at 
the stop at a random moment ¢* (Fig. 10.17a). He boards a bus if it is 
at the stop and waits for a time tv’ if there are no buses, and, if no 
buses arrive at the stop during that time, leaves the stop and walks 


T, lo Tz 
T i ps T’ T T t 
(2) 
Pericd for ertod for Period for 
Passengers DASSENQETS passengers 
to board td? 000208 Co boareal 








7* 
(a) 





Fig. 10.47 


lohis destination. The distribution j, (¢) is such that the random variable 
I cannot be smaller than t+ 7’ (Fig. 10.176). Find the probability 
that the passenger will take a bus. 

Solution. We consider the opposite event A =({the passenger will 
not catch a bus}. This means that when the passenger arrives at the 
stop at a moment i* there are no buses at the stop, and no buses arrive 
during the period he waits. Each event, i.e. the arrival of a bus at the stop, 
is followed by a period for the passenger to board, the width of the 
Period being +’ + t+ (Fig. 10.17c). 

The event A = {the passenger does not catch a bus} corresponds to 
the point 7 falling outside the boarding period (Fig. 10.17d). The point 

1a8 a uniform distribution over the whole length of the interval 7*. 
The probability that it wil] fal] on the interval T* — (t + 1’), which 


= Outside the boarding period, is (by the integral total probability 
formula) 





— ; oe ae ’ ry oe . tf 
P(Ay= | ARE fey dt= at) f(t) at 
THT THU’ 
1, ‘ -£ 
=— \ tf (t) dt — — | f(t) dt. 
THT’ TT’ 


— m; is the average interval between buses. 

; ; Probability that the passenger will catch a bus is P (4) = 
~ (A). 

10.18. An elementary flow with intensity 4 is subjected to the fol- 


Wing transformation. If the distance between adjacent events T; 
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is cmaller than some permissible limit ¢, (a ‘safety interval"), then 
the event 1s displaced by an interval ft, relative to the preceding event 
Now if 7, = 2o, then the event remains put (Fig 1018) Is the trans 
formed flow formed by the points Oj, @2,..., on the #’-axis elemen 
tary? Is it a Palm flow? 

Solution. The transformed flow is neither elementary nor Palm's 
since it has an aftereffect that can extend arbitrarily far For example, 


Oo) % & & 8 bs 6, 0% &, 8, 
i 
| I | 
[ | 
| y i, tr 4 to ¢ , 
f A, Po paren a a poe r 


a a a -) rn a 
Fig 1018 


the points 8, ©, G,, G,, crowd the t’-axis and so every subsequent 
point on the ¢ axis is shifted by a time interval which depends both 
on when the events occurred and on the intersals between them in the 
past If ¢, 1s much Jess than the average distance between the events 
in the original flaw re ¢, < 1/4, then we can negtect tlie aftereffect 
in the transformed flow 


i | 
| l aly molt i; 4a 


Fig 1019 


1019 Two independent Palm flows with distribution densittes 
f, (t) and f, (¢) for the interval between the events are superimposed 
Is the resultant flow a Palm flow? 

Solution The superposition of two Palm flows 1s shown 10 Fig 10 10 
It 1s clear that the intervals 7,, T, of the resultant flow III are 
not independent since their sizes are defined by those of the same 
mmterval on the axis I or [I For instance, 7, and 7, add together te 
give I,, and, hence, they are not independent Thuis relationship 15 
rapidly damped, however, as the period between the origins of the 
intervals increases 


Remark. We can prove that when a sufficiently large number of Palm's flows 
with comparable intensities are superimposed, a flow regults which is close to © 
elementary flow 
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10,20. A computer, when it isrunning, can be regarded as a physical 
system S which may be found to be in one of four states: (s,) the com- 
puter is completely sound, (s,) the computer has a negligible number 
of faults in the memory and it can continue to solve problems, (s,) the 
computer has a considerable number of faults, but it continues to solve 
a limited range of problems, and (s,) the computer goes down com- 
pletely. 

Initially the computer is completely sound (state s,) and is checked 
at three fixed moments f¢,, ¢., ¢,. The process in the system S can be 
regarded as a homogeneous Markov chain with three steps (the first, 
the second and the third check of the 
computer). The transition probability 
matrix has the form 


0.3 0.4 0.4 0.2 
0 0.2 0.5 0.3 

WPell= 0 oO 0.4 O.6II’ 
0 oO OO 4.0 


Find the probabilities of the states of 
the computer after the three checks. Fig. 10.20 
Solution. The directed graph of lai 
the states of the computer is illus- 
trated in Fig. 10.20. Each arrow shows the transitional probability. 
oy probabilities of states p, (0) = 1 and p, (0) = p,; (0) = 
Pa \V) = VY, 
Using formula (10.0.4) and taking into account in the sum of prob- 


abilities only those states from which a direct passage to a given 
State is possible, we find 


p, (1) = p, (0) Py = 1 x 0.3 = 0.3, 

Do (1) = p, (0) Pip = 1X 0.4 = 0.4, 

Ps (1) = p, (0) P},, = 1x01 = 0.4, 

Pp, (1) = p, (0) P,,g = 1x0.2 = 0.2, 

Pp, (2) = p, (1) Py, = 0.3 x 0.3 = 0.09, 
Ps (2) = p, (1) Py. + po (1) Pog = 0.3 0.4 + 0.4% 0.2 = 0.20, 
Ps (2) = p, (1) Pus + pe (1) Pos + ps (1) Pag = 0.27, 
Py (2) = Py (1) Pug + pe (1) Pos + Ds (1) Pas + pg (1) Pay = 0.44, 
P; (3) = p, (2) P,; = 0.09 x 0.3 = 0.027, 
Ps (3) = p, (2) Py, + po (2) Pag = 0.09 x 0.4 + 0.20 « 0.2 = 0.076, 
D3 (3) = Py (2) Pig + Pe (2) Pos + Ds (2) Ps3 = 0.217, 
Ps (3) = p, (2) Pig t+ Pe (2) Pos + Ps (2) Pos + pg (2) Pyy = 0.680. 
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Thus the probabilitres of states of the computer after three checks 
are p, (3) = 0027, p, (3) = 0 076, py (3) = 0 217, p, (3) = 0 680 

102! A point S walks along the z axis (Fig 10 21a} so that at 
each step it remains put with probability 05, pumps to the right by 
unity with probability 0 3 and jumps to the left by unity with prob 
ability 02 The state of the s}stem S after A steps is defined by one 
coordinate (abscissa) of the point S The initial positron of the point 
13 the origin Considering the sequence of positions of the point § 





nag Ge 


Gs i) tr) fe iS 





Tie {10 2! 


to he a Markov chain find the probability that after four steps 1t will 
be no farther than a unity from the origin 

Solution We designate the atite of the system (point S) as s; where 
t 18 the coordinate of § on the abscissa axis The marked graph of states 
isshown in Fig 10 21b (For the sake of clarity, loops are shown in the 
figure which correspond to the delays of § in the previous posilion 

The sequence of states forms a Markoy chain with an infinite number 
of states The transition! probabilities P,; are nonzero only for j =i; 
fjei—t,f=r4i Py, = O86 Piggy, = 03 Pri = 04 All 
the other transitional probabilities are zero The required probability P 
is equal to the sum of probabilities p, (4) -+ p, (4) + By (4) We can 
find them using the recusrence relations (410 0 14) 

Vee have p, (0) =1 p, (0) = p, (0) = = @ Furthermore 


Po (1) = po()P,,=05 p, (ft) =p, (0) Po, = 03, 
Poy (1} = Py (1) Py 1, = 0 = 
ro (2) = po A) PL, tm OP» +p, GU) Py) = 05x05 
+02x03403x02 =037 
pr, (2) —- po A) Poy +, 1) PL, = 05x03 +0305 = 090, 
Ps (2) = p, (1) Pye = 03X03 = 009, 
Por (2) = po 1) Poy +p, (4) Py, = 05x02 402x05 = 0 20 
Poo (2) = p., GU) Pig = 02x02 = 004, 
Po (8) = po (2) Pog +21 (2) Pio + Pes (2) Py» = 0 305, 
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Py (3) = Po (2) Poa > Pi (2) Py, +r Pe (2) Pos = 0.279, 
Po (3) = Pi (2) Pijg + Pe (2) Poo = 0.130, 
P3 (3) = Pe (2) Pos = 0.027, 

py (8) = Pu» (2) Plea 7 P- (2) Pia + Po (2) Poa = 0.186, 

Po (3) = P-2 (2) Ple-e + Pa (2) Py» = 0.060, 

p.3 (3) = P-2 (2) Pes = 0.008, 
Do (4) = Py (8) Pro 1 Po (3) Poo + Pot (3) Pio 0.264, 
py (4) = Pe (3) Pea + Pi (3) Pia + Po (3) Poa & 0.20%, 
py (4) = Po (3) Po,-1 - P-1 (3) Piya + P-2 (5) Pea ~ 0.4172. 
The required probability 


p = Do (4) + Px (4) + Por (4) © 0.690. 


Thus the probability of the event A that after four steps the point & 
will be no farther than unity from the origin is 0.693. 

(0.22. Under the conditions of the previous problem find the prob- 
ability that at no time during the four steps was the point S farther 
than unity from the origin. 


Solution. We designate as Do (k), py (A), Poa (k) the probabilities. 
of statesso, s,,$_,, provided that up till the Ath step inclusive the point S 
was never farther than unity from the 
origin. 

At first glance this process is not 
a Markov chain (since the proba- 
bilities of future states depend on the 
prehistory”, i.e. on whether the 
point S was at least once farther than 
unity from the origin), but it can 
be reduced to a Markov chain by 
mtroducing another state, s*, which 
corresponds to the point having gone 
farther than by unity from the origin 
at least once. 

The directed eraph of states is illustrated in Fig. 10.22. There is: 
NO passage from state s* to any of the other states, in Markov chain 
theory such a state is known as an absorbing state. The probability of 
the event A = {in four stops the point S will never be farther than 
unity from the origin} can be calculated as the sum of probabilities 


0.5 0.5 0.5 





Po (4) +- po, (4) + Py (4) for a system with a graph of states correspond- 

rt to that shown in Fig. 10.22. We invite the reader to calculate 
lese probabilities. 

e 3. A system S consists of a technical device made up of m units, 
: ich from time to time (at moments 1%), fa, - « «. t;) undergoes pre- 
entive maintenance and repair. After each step (the moment of main- 


Ji6 Applied Problems in Probabillty Theory 


tenance and repair) the system may be in one of m states (s,) all the 
units are sound (no untts are replaced by new ones) (s,) one unit is 
seplaced by a new unit and the other units are sound (s,} two units are 
replaced by new ones and the other units are sound S$; — t units 
{i <2 m) are replaced by new ones ane the other units are sound So 
all m units are replaced by new ones 
The probability that at the time of preventive maintenance a unit 
will be replaced by 1 new one ts p (independently of the states of the 
other units) Considering the states of system S to be a Markov chain 
find the transitional probahilities 
O21§ 238 at) f and calculate the probabriittes 
of system S for m=3 and 
} ~ 04 after three steps (int 
tially all the units are sound) 
Solution We write the transi 
tional prohabilities of the chain 
designating q = 1 — p For any 
state s; of the system the prob 
abnlity P,, 1s zero for y<t 
Fig f0 23 the probability P,, us equal 
to the probability that no units 
will have to be replaced by new ones ata given step 1e m-—i 
of the old units remain in the device Py, = g™ * For i<¢j the prob 
ability of the transition Py, 15s equal to the probability that at a given 
<tep 7 — i? units out of the m —~ 2 old units will have to be replaced by 
new ones Using the binomial distribution we find P,,=Citp? tg” 2 
The state s,, 1s absorbing For m = 3 p =04 the directed graph of 
the states of the <ystem has the form shown in Fig 10 23 


0216 0432 0288 0064 
ip,n—-|2 038 948 0 46 

0 0 06 O04 
0 0 oO 140 


We hay = _ _ _ 
probability bf states after cre pave Aho) speog 0) =O Ne find mis 

pe (1) = 0216 p, (1) = 0.432 

P, (1) = 0 288 pz (1) = 0 064 

Py (2) = p, (1) Pa + po (1) PL, we 0 249 

P, (2) = ps (1) Par — Do (1} Pog + p, (1) Pi, oe 0 442 

Ps (2) = ps (1) Pgs + pe (1) Pog +p, (4) Pre + 9 (1) Pog 0 262 

Po (3) = Po (2) Poo 0 O10 

Py (3) = py (2) Pr -r Pa (2} Py, sO 110 

Pe (3) — pa (2) Par + Pg (2) Py, + P, (2) Pr, a 0 398 

Ps (8) = py (2) Pgs + Po {2} Pog + py (2) Pes + 2 (2) Poy 0 482 
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10.24. A computer is inspected at moments ¢,, t, and ts. The pos- 
sible states of the computer are: (s,) it is completely sound; (s,) there 
are a negligible number of faults, which do not prevent the computer 
from functioning; (s,.) there are a considerable number of faults, which 
make it possible for the computer to solve only a limited range of 
problems; and (s,) the computer goes down. 

The transition probability matrix has the form 


0.5 0.3 0.2 0 
0 04 0.4 0.2 
NPoll=g 9 03 0.7 
0 0 0 1 


Uonstruct the directed graph of states. Find the probabilities of the 
States of the computer after one, two, and three inspections, if at the 
beginning (¢ = 0) the computer was completely sound. 


0.5 0.4 0.3 7 





Fig 10.24 Fig. 10.25 


Solution. The graph of states is shown in Fig, 10.24, 

Po (1) = py (0) Pop = 1 X 0.5 = 0.5, 

P; (1) = py (0) Pop, = 1 X 0.3 = 0.3, 

Py (4) = py (0) Pypo = 1 X 0.2 = 0.2, 

Po (2) = Po (1) Poo = 0.20, Py (2) = Po (1) Pot + Py (1) Pu = 0.27, 

Pa (2) = po (1) Pos + Pr (4) Par + Pa (1) Pos = 0.28, 

Ps (2) = py (1) Pos + p, (4) Pig = 9.20, Do (8) = pg (2) Pog = 0.425, 

Ps (8) = po (2) Poy + Py (2) Pr = 0.183, 

Pa (8) = py (2) Poo + p, (2) Pre + Pe (2) Poo = 0.242, 

P3 (8) = Py (2) Pus -+ pe (2) Pog + Da (2) Pas = 0.450. 

10.25. We consider the operation of a computer. The flow of failures 
(malfunctions) of an operating computer is an elementary flow with 
ensity A. If the computer fails, the malfunction is immediately 
elected and the computer is repaired. The distribution of the time of 
- pair is exponential with parameter p: @ (t) = pe-Ht (t > 0). At the 


es moment (¢ = Q) the computer is sound. Find (1) the probability 
at ata moment ¢ the computer functions; (2) the probability that 
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during the time (0, ¢) the computer malfunctions at least once (3) the 
hmiting probabilities of the states of the computer 

Solution (1) The states of the system (the computer) are (s,} 1t 13 
sound and functions, {s,) 1t 1s fruity and is repaired’ The marked graph 
of states is shown in Fig 10 Zoe 

The Chapman Kolmogorov equations for the probabilities of states 


Pp, {t) and p, (f) have the form 
d n iT _ 
ro BPA MPs Tt = Apo EPs (10 25 1) 


Father of these equations can be deleted since for any moment f we have 
Pa + p, — 1 Substituting p, = 1 — p, into the first equation (£0 23 f} 
we obtain one differential equation with respect to py 

dpoidt = p — (A + yt) Po 


Solying this equation for the initial condition py, (0) = 1, we obtam 


polt)= pe [t+ Senate], (10 25 2) 
whence 
p(t) — pay [1 e Ot wt (10 2a 3) 


(2} To find the probabihty p (t} thal during the time ¢ the computer 
malfunctions at least once we introduce new states for the system 


(s)) the computer never failed (s,) the computer malfunctioned at least 
once The state s, 1s the absorbing one (see Fig 10 255) 

Soliing the Chapman holmogorov equation dp,/dt = —} Dg for the 
inttial condition Po (0) -— 4 we get Do (f} = e7*!, whence Dy (f) = 
1 —~ Bo ({) = 1—e 4t Thus the probability that during the time ¢ 


the computer malfunctions at least once ts P ((t)} = 1—e ?t In ths 
case the probability could have been calculated more aimply re as the 
probability that during the time ¢ at least one event (malfunction) 
will oceur in a elementary flow of malfunctions with intensity A 

(3) As t—> co we get from equations (10 25 2) and (10 25 3) the 
Ihmiting probabilities of states p, = wii -- a) py == AMA + 1) which 
could eventually have been obtained directly from the praph of states 
using the birth and death process (we invite the reader to do this) 

10 26 On the hypothesis of the preceding problem the malfunctioning 
of the computer 18 not Immediately noticed but 3s detected after an 
interval of time which has an exponential distrrbution with parameter V 
Write and solve the Chapman Kkolmagoroy equations for the probabil 
ties of states Find the himiting probabtlities of states (from the drrected 
eraph of states} 

Solufion The states of the system are (s,) the computer 18 sound 
and operates (s,} the computer 15 faulty but the malfunction 13 not 
detected, (s,) the computer 1s heing repaired The graph of states 13 
shown in Fig 10 26 
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The Chapman-Kolmogorov equations for the probabilities of states 
are 


d A d d 

= UW Po—APo, A =hpy— VE <2 = VPy— Pp. (10.26. 1) 
We shall solve this system using Laplace transforms. With due regard 
for the initial conditions for trans- 
forms nm; of probabilities p;, equa- 
tions (10.26.1) assume the form 


SNy = UN — Ady + 1, 





ST, = Ao — VIL 4 
Sy = VIty — JlTo. 


Fig. 10.26 


Solving this system of algebraic 

equations, we get the following equations for the transforms: 
_ oY _ viv 

py Te ME CEI FO) 

_ (s-¢¥) (SFB) 

Os (Ss? 8 (U-v--A) -E VA vp ME) * 

We introduce the designations 


uy, = Tos 


a 


gave 1 yf ev EM yh vp — Ap ; 


i — ete th yf Bee vn 
Then the expressions for probabilities assume the form 
qeat — debt eat abt 4 beat — gabt 
Po (t) = + (vp) +o | op t+ ay | 


eat._obi 4 beat — qedt | 
; 


Py (t) = ——— +p Ee T b@—6) 


4 beat —. gebt 
Ps (z) = VA, |=+ ab (a—b) ° 
To find the limiting probabilities, we can use either the transforms 
or the probabilities themselves: 
Lv 
ApubaAv-vi 7 
_ Ay = ee AY 
MEd? P= 1 Pom P= pipe + (1026.2) 
. We can find the final probabilities of states directly from directed 
graph In Fig. 10.26: tps = Po, APo = VP1, VP: = [Py. We can delete 
ne of these equations (say, the last one). Expressing p, in terms of 
Pc and py, i.e. Po = 1 — Py — Pi, We get two equations 


BL — po — Py) = Apo and Apo = vpy. 
The solution of these equations yields the same results (10.26.2), 


Po= lim Po (t) = lim sx, (s) = 
t—co s+ 
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1997 An electronic device consists of tuo identical repeating units 
For the device to operate it is sufficient that at least one unit functions 
When one of the units fails, the device continues to function normally 
due to the other unit The flow of failures of each unit is elementary 
with parameter 4 When a unit fails, 1t 1s immediately repaired The 
time needed to repair the unit ts exponential with parameter p Initially 
{¢ = 0) both umits operate Find the following characteristics of the 
operation of the device 

({} The probabilities of states (as functions of tame) (s,) both units 
are sound, (s,;) one unit 18 sound and the other 1s being repaired, (s,) both 
units are being repaired (the device does not operate) 


22 a 2% 24 — 
So 5 oT | Eqown ka 
#e 


## é fi 


(a) (5) 
Boes rat Baegs nat 
fperates operate Goerates operate 
a oF —A~—. an a ae 
(¢) 
Fig 10 27 


(2) The probability p (¢) that during time ft the device never fails 

(3) The limiting probabilities of states of the device 

(4) For the limiting (stationary) conditions of the device the average 
relative time for which the device will operate 

(5) For the same limiting conditions the average time f,p of failure- 
free operation of the device (from the moment it 13 switched on after 
being repaired till the next malfunction) 

Solution The directed graph of states of the device 1s shown 1D 
Fig 10 27a (24 1s put before the upper left arrow since two units operate 
and may fail) for the same reason 2u 1s put before the Jower right 
arrow since both units are berng repaired) 

(1) The Chapman holmogorov equations have the form 


dp 





d 
$2. = [tPy— QAPg a ~ Dhpot Qupe—{h-+ HW) Pas 
EP a hpy— Qe ppe (10 27 t} 


In this case the following condition must be fulfilled p4 -+ py + Pa = 1 
Solving this system of equations for the initial conditions py (0) = 1, 
Py (0) — pz (0) = 0 we obtain 


goat paybt ect oogbht bea? — qebl 


Pq (0} = ——— — + (A+ Sp) aan + eR lta ’ 
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where 
a=—(Atp), b= —2 (A+B), 


a—b=)A+yp, ab=2(A+p)?, 


__ arett__ b2edt (A-+- 8p) (aett — debt) Qu (eat — edt) 
Ps!) = p. (a— b) pi (a@—b) - a—b 


From the expressions obtained we get 
P2 t) =1— po ()— pi ft) and py (0) = 0. 
(2) To find the probability D (t), we make the state s, (the device 


stopped operating) absorbing (s,) (Fig. 10.27b). For the probabilities. 
oi the states the Chapman-Kolmogorov equations are 


dpildt = pp, — 2p, dp,/dt = 2apy — (A+ p) Pir Gpo/dt = Apy. 
Solving the first two equations under the initial conditions p, (0) = 
1, p, (0) = 0, we obtain 


+= Po (2). 


Where 


owe (BA + VF Apt pe? g = — Shy) — V + 6Ay-+ we? 
2 : - 2 


(the quantities « and B are negative for any positive values of 4 and p). 
urthermore, 


{ dpo 2n~ 41 T ate? Beeb! 


2 aaa ye 7 Po —e¢—p 
at _e,Bt nw 
+ (a+ p) “=F | 4 = Bole). 


The required probabilities p (t) = Do (t) +p, (t). Note that the function 


P(t) is monotone decreasing, and p (0) = 1, p (oo) = 0. 

i) The final probabilities of states can be found from the graph in, 

he 10.27a and the general formulas (40.0.23) for the birth and death. 
ocess 


_ 24 ae A \2 
Pr=—— Poi Po=ar Po=(-~) Pos Pot Pit Pe=1, 


Po= [1+ 2A/n + (A/p)Ayt = w/(A + 1). 


(4) The average relative time for which the device will operate is 


en n% \2 Cn ee wn \2 
- po=1—(—} beer) wae er) 
(0) The variable top is the expectation of time 7,, which passes 


Hh the moment the device is switched on to the moment of its next 
re, 
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Let us consider the operation of the device in stationary conditions 
lo consist of a number of cycles ‘operates’ and “does not operate” (sea 
Fig 10 27c, where the operating sections are shown tn bold line) The 


average time foonop for which the device does not operate (the expecta 
tion of the length of a nonoperating period} is evidently 1/(2,) (since 
a flow of transitions to an operating state with intensity Patt acts on the 
device which 1s in the nonoperating state). 

Furthermore the ratio of the average time of trouble free operation 


t,,, to that of “nonoperation” tnonop is equal to the ratio of the final 


A a —. 4 — 4 = 
2) mee Fees FE 
ft é 
ai # {4) 


lig 19 28 


probability 1 — p, (that the device ss 3 Operating} to the probability 5, 
(that it does not operate), 1e. Ea p/tnonon = {{ — p,j/p,. From this, 
bearing in mind that troop = 1/(2n), we get 


i — Ff 1—p, _ if 1— py 
cp Fnpnop Ps — Zu Pa 


10 28 The conditrons and questions are the same as in Problem 10 27 
except that as long as one of the units operates, the other 1s hept 12 
reserve and so cannot fail When the reserve unit 13 svitched an iu 
begins operating at once and 18 subject to a flow of failures with inten- 
sity A 

solution The directed praph of states of the device has the form 


shown in Fig {0 28a and the graph with an «absorbing state in 
Fig 10 28), 


Answers 


Prant —pedt entmels boat .. gett 
(T} Po (f) = == — + (44 3p) 2p? [+ “ablas-b) J' 





_, sett —b2obt er at hit 
P, (t} wa=-ty tT ia=sy (ae! = be") 
2b faa ‘ 
T a—b le ‘= 0"] = Po (ft), Pg (£) = 1 py (ft) — py (f), 
ge ESE 4p i ae bea — (2h Sal V Spa pt 
2 7 3 


re coat! oe .hF 
{2} Po (t)—= SO ty a ' 


_ t gat o9.ft att _ Bi m 
Pr (t) = 5 [SS at) SE + pol 


a—B 


pat - nw (43 theca 
Py (t)=1— py (t)— Py (2), = WAY ee 
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—(A2+p)—V Sapte ~ 
erway eee, p(t) =1— py (t), 


p 
rape m=Z() Po pe=[1+7+3(F) 
(4) 1—p,; (9) ieee 


10.29, The conditions of Problem 10.27 are changed so that the 
nonoperating unit is in a reduced reserve and may still fail with inten- 
sity A’ << 2. (1) Construct the directed 
graph of states of the device and write Ard! A 
out the Chapman-Kolmogorov equations S| SL 
for the probabilities of states. (2) With- 2 
out solving the equations, find the lim- 
lting probabilities of states; calculate Fig. 10.29 
them for A= 1, A = 0.5 and p = 2. 

(3) Using these numerical data, find the average time top Of the 
trouble-free operation of the device. 

Solution. (1) The directed graph of states is shown in Fig. 10.29 and 
the Chapman-Kolmogorov equations are 


d d ' , 
= (EN) pot ip, Ph = — (A+B) pet (A4M) pot Qu, 


PotD + Pe = 1. 


(2) The limiting probabilities of the states can be found from the 
general formulas (10.0.23) for the birth and death process: 


— AEN (NEM) A _ WEA | (ASA) A 7A 
te r Pos Po=—g2 Po Po= {1+ + eh : 


Substituting here A = 4, A’ = 0.5, and w = 2, we get 





Pos {1 + 42 4 LOXE V"" ~ 0.546, p, = 0.387, p, =~ 0.097. 
7 —_1 1—p, as 
(8) tp Pt ow 2.32. 


10.30. A computer includes four disk Storage units. A team of four 
Carries out a preventive inspection on each disk. The overall flow of 
"vents, i.e. moments when the inspections are finished by the whole 
team, Is a Poisson flow with intensity A (t). When the inspection is 
inished, a disk is checked and may prove serviceable with probability p 
the validation time is small as compared to the time of inspection 
and can be neglected). If a disk proves nonserviceable, it is again sub- 
ected to inspection (the time needed for this operation does not depend 
on Whether an inspection was carried out before) and so on. At the 
ginning all the disk units need preventive inspection. 

, scnstruet a directed graph of states for the system S (four disk units) 
“Md Write the differential equations for the probabilities of states. Find 
“3~0575 
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\[,, the expectation of the number of disks which successfully pass the 
inspection by the moment 7 

Solution (s,) all four dish units need preventive inspection, (s,) one 
disk unit successfully passed the tnspection and three disk units need 
repair, (s,) two dish units successfully passed the inspection and two 
need repair f{s;) three disk units successfully passed the inspection 
and one needs repair, (s,) all four units successfully passed the inspec 
t10n 

The fact that each maintenance 15 successful with probability p is 
equivalent to a p transformation of the flow of inspection completions, 
after which the flow remains a Poisson flow, but with intensity pA (i 





Tig 10 30 


The directed graph of states 1s shown in Fig 10 30, andythe Chap 
man Kolmogoroy equations are 


dp ,fdt = —p (ft) Pp dp, jdt = ph (f} (Po — Dy) 

dp idt = pi (t) (py — Pe) dp,idt = ph (t) (P, — Ps): 
dp,/dt = pi (t) ps (10 30 1} 
The initial conditions are p, (0) = 1 and p, (0) = == p, (O0)"= 0 





Tig 16031 


The expectation of the number of disks which successfully passe 
the inspection by the time v is 
4 


Me== 2a p21 (1) (10 30 2} 


i=! 
At a constant intensity 4 the solutions of equations (10 30 4) are 


i 
Do(t}=en4Pt, pi(f)=Apte-*t, p(t} = Leet, 


(Ape) : 
pa()=FE enter, p(t) 4t— 3) ill) 

10.31, On the hypothesis of the preceding problem each member of 
the team is assigned one disk unit which he must maintain The flow 
of the inspection completions per team member has infensity 4 (2)/4 
Answer the questions in the preceding problem. 
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Solution. The directed graph of states is shown in Fig. 10.31 and the 
Chapman-Kolmogorov equations are 


dp,idt = —ph (t) Po, dp,/dt = ph () (Po — (8/4) Pi): 
dpo/dt = ph (t) (3/4) pr — (1/2) De): 

dp,/dt = ph (t) ((1/2) P2— (1/4) Ps): 

dp,/dt = (4/4) ph (t) Ds 


Expression (10.30.2) for M, remains the same for this situation. 

10.32. A device is subjected to an elementary flow of faults with 
intensity 4. A fault isnot detected at once but only after a random 
time interval which has an 
exponential distribution with 
parameter v. As soon as a fault 
is detected, the device is inspect- 
ed and is either repaired (with 
probability p) or rejected and 
replaced by a new one. The 
time needed for the inspection 
Ils exponential with parameter 
y, the time needed for repair 
is exponential with parameter Fig. 10.32 
ul, the time needed for replacing 
the rejected device by a new one is exponential with parameter x. 
What are the limiting probabilities of the states of the device? 
Find (1) the average time for which the device will operate normally; 
(2) the time for which the device will operate with an undetected failure 
(produce reject); (3) the average cost of repairing or replacing the device 
per unit time if the average cost of repair is r and that of a new device 
is ¢; (4) the average loss per unit time when the device operates with 
an undetected refusal if the operation of such a device entails a loss 2 per 
Unit time. 

Solution. The states of the device are: (S)) the device is sound and 
operates normally; (s,) the device is faulty but a failure is not detected, 
the device produces rejects; (s.) the refusal is detected and the device 
ls Inspected; (s,) the device is repaired; (s,) the device is replaced. The 
directed praph of states is shown in Fig. 10.82. 

The algebraic linear quations for the final probabilities of states are 


ADn = UDs + XPy, APo = VPy, VPi = YP2. PVP2 = tts, 
(1 — p) YP2 = “Pa: 


= normalizing condition is po + Pi + Pe + Ps + Py = 1. Solving 
ese equations, we get 


ny » Ns 1—p)rX ]-! 
p=[t+ete+ e+ | : 


ov, 
a: A . 1—p) 
Pi=—> Po P,=— Por D3 =—~— Pos pyp= SP p,. 





Tie 
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(1) The average time of normal operation of the device 1s p, (2) p, 
{3) For an average fractron of time py the device 1s being repaired 
every time the repair lasts for 1/, on the average, the flow of repaired 
devices, coming out of the state s, has intensity pp, the average cost 
of repairs per unit time is rup, Siumilarly the average cost of new de 
yices per unit timeisexp, the total average cost of both is rpp, -+ cup, 

4) Tho average lossos 2 faulty device entails per unit time are ivp, 
110 33 We now consider how records are stored 1n a data bate of a com 
puter The intensity of the records to be included in the bases 1s A (é) and 
does not depend on how many records have been stored Every record 1s 
stored in the data base for an infinitely long period of time Find the 
characteristics m.. (t} and Var, (/) of the random function A (tj), which 


Ae) att) at), |, al att 


Fig {033 


1s the number of records stored in the data base provided that the in 
coming records arrive mm a Poisson process with intensity A (¢}, and at 
= 0 the random function X (0) = 0 

Solution In this problem we deal with a process of ‘pure birth 
without any restrictions being imposed on the number of states (n — oo} 
Oe birth rates A, = A(t) (Fig 1033) and the death rates ji, = 
LE j= 

For this case differential equations (10 0 24) and (10 0 25) assume 
the form 


ne) _ At ra ()=2(0, 
f—- (J 
d Vary (£) ne 
SD OLA) + PKA (8) — 2m, (AO pe (HAO, 
A= 
Since 
2) P(t) =! 2 Apa (t)= my (0 


Solving these equations for the initial conditions m, (0) = Vary (0} = 
QO we obtain 


t 
m,(t)= Var, (t)= | &(n) dt 
0 
This result should have been expected since it can be found directly 
from the theory of flows We can prove that for any moment ? the ran 
dom variable X (i) has a Poisson distmbution with the characteristzs 
my, (f) = Var, (tf) obtaned 
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10.34. The conditions are the same as in the preceding problem except 
that a record is stored in the data base for some time after which it is 
deleted according to some criterion. The flow of deletions for each 
record is a Poisson process with intensity y (2). 

Solution. In this problem we have a birth and death chain for the 
number of records in the data base. The death rate p, (¢) = ky (é) 
since } records are stored in the data base in the state s, and each record 
is acted upon by a flow of deletions with intensity w (@). 

The differential equations for the functions m,. (¢) and Var,, (¢) have 
the form 








7 (t) S| (X(t) — ku (t)) py, (t) =X (1) —w(t)m, (1), (40.84.4) 
h=0 
d Vars OS [A (t)-+ hey (t) + QED (t) — 2h?p (¢) — 2m, (t) A (2) 
k=0 
+ 9m, (t) eu (t)] Pr (t) ——) (t)-+u (ft) m,, (Z) —2u (t) Var, (t), (10.34.2) 
since 


> pr(t)=1, Dy kp, (t)=m, (t), 
hk=0 R=0 


2) k2 pp (t) = Oa (t) = Vary (t) + mi (t). 
R=0 
For the initial conditions m, (0) = m, and Var, (0) = Var,; for 


Constant intensities for the addition and deletion of the records, i.e. 
W(t) = 4 and u(t) = u, the solutions of these equations have the form 


j dr A 
Mx (t) = mge- Ht 4 ~ me i Soke a (11 — -) 


Wi og7 Ht 


Vary (f) =a [4 O28] tap Vary + pm) 


+ Vary (Qe-2ht — e- Ht) = m,, (t) + (Vary — m,) em 2HE, 


eg ~Hi_ig-enut 
yt 


For the initial conditions Mtg = Vary = 0, we get m, (t) = Var, (t)= 
7 (i—e-Bt), We can prove that for these initial conditions the process 


of storing information X (¢) has a Poisson distribution for any moment # 
and for any kind of function i (t) (the intensity of the addition of a rec- 
ord), but for this to take place the deletion intensity u for the records 
Must be constant. 

r constant A and p and ¢ + oo, stationary conditions of information 
Storage will be established, which naturally do not depend on the initial 
Conditions: mM. == Var, = A/w. 

0.35. We consider the process of manufacturing a type of computer. 
© manufacturing intensity of the computer 4% (t) is shown in 


Vig. 10.35¢. It increases linearly during the first year from 0 to 1000 com- 
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puters a ycar, for three years the production stays at 1000 computers 
a year, and then the computer 15 taLen out of production The avera 
service life of a computer 1s five years Considering all the flows of 
events to be elementtry, find the mean value and sayiance of the num 
ber of computers in service at any moment é 


Aft} 
1000} “= 






} 2 3 4 ¢ 
(2) 
FY 
My be , ana <5, 
Leta ge ft} #3 ft} Hy ft} By th 
fA) 
my Jo Ot 
a5ee ee 
J 20 
pean 2at3 
eee 
158 f | 
rot $20 
see 7 
f 4 F & 7 @ F fh  ¢t gears 
(¢) 
Fig 1090 


Solution The manufacturing intensity for the computer 
QO for t<<0, 

kt for Osct<tl, 

% for imt<c4, 

0 for tr4, 


where A = 1000 f/year? 2&4 = 1000 4/year 


Let us find the solutions of equations (10 34 1) and (10 34 2} for the 
fime interval 0 =< it<< 1 under the condition that n= O2 tfyear for 


any time intervals t>>0 Under these conditions equation (10 34 4) 
has the form 


2 (t) = 


dm, { 
ATU) = kt pm, (2) 
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Solving this equation for the initial condition m,. (0) = 0, we obtain 
Is o t 
m, (1) =e (eM — 1 + pt) = 25 000 (et —4-+—), 


In a year’s time an average of m, (1) = 25 000 (e 7? — 1 + 0.2) = 
468 computers will be in service. Note that if the service life of the 
computers were infinite, then up to 500 computers would be in service 
by the end of a year. 

Under the same conditions equation (10.34.2) has the form 


dVar,. (t)/dt = 1000¢ + 0.2m, (t) — 0.4Var,, (t). 


Solving this equation for the initial condition Var, (0) = 0, we get 
Var, (f) = m,, (t) = 25 000 (e775 — 1 + t/5). In a year the variance 
of the number of computers in service will be Var, = 468, 0, = 21.6. 
The number of computers in service in a year’s time will be approxi- 
mately normally distributed with characteristics m, = 468,0, = 21.6. 

Qn the time interval 1 <¢t< 4 the corresponding equations wil] 
have the form 


me 
Ste () =A—pm,, (Zz), SNE A -+- wm, (t) — Zp Var,, (¢). 
We must solve them for the initial conditions m,, (1) = Var, (1) = 468. 


ie found a solution of these equations in Problem 10.34, whence we 
1ave 


M(t) = My (1) em~HE-D 4 (L—erMED) (1 7-< 4), 
Var, (t) == my, (t). 
Let us find the value of mx (#) for t = 4: 
my (4) = my (1) e~8H + — (1 — 0-H) = 2513. 


Thus the average number of computers in service by the end of the 
lourth year is 2543. Pay attention to the fact that an average of 
OUU computers were manufactured by that time. Consequently, an 
erage of 987 computers were taken out of service during the four years. 

A process of “pure death” whose graph is shown in Fig. 10.35b will 
lake place on the time interval t > 4. 

na general case the differential equations for the mean value and 
‘arlance of the pure death process have the form 


ama (O —~ >) Br (t) Pr) 
6 


1. ©) 


S Meta (8S) [ate (t) — 2h uy (0) +25 (t) Fun (0) Pa (0. 


k=-0 
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For our case pw, (t) = Aye and consequently, we get an equation 


Sr) — Sheps (t) = — pm, (f) 
A=0 


which we must solve for the imitial condition m, (4) = 2513 The 
solution of this equation has the form 


m, (f) =m, (ApenMt DB (f£> 4) 


Since Var, (4) — m, (4) and pp = const we have Var, (f) = m, (6 
on the time interval £ >> 

Figure 10 35¢ shous a relationship between m, (f) 1e the average 
number of computers inservice and time? The dash line shows a graph 
of the average number of computers manufactured by a certain time 
i yesus time ¢ 

10 36 We now consider the process of storing terms in a directory 
inadata bank The proce $s 15 to include the terms In the directory wl en 


rs | t} oe i) A 5, te in Ay 5] 


Fig 1036 





they first appear For example the names of organizations for which 
a factory has production orders are entered into the data bank of the 
management information system The entries for the names of the 
organisations will be accumulated in the data bank of the management 
information system in the order in which they appear in the input 
records 

There are an average of x terms in the directory in every record fed 
into the data bank and the intensity of feeding the records into the 
data ban) is 4 (?} Consequently the intensity of the flow of terms fed 


into the data bank 1s 4 (ft) = x2 (t) We assume that this 1s a Poisson 
flow The number of terms 7m 1s finite and nonrandom although 1t may 
net be known beforehand All the terms tn the directory may appear 
in a record with equal prebability while naturally onl, those terms 
are fed into the directory that did not yet appear in the records Find 
the mean value and variance of the number of terms in the directory 

Solution We designate the number of terms in the directory as X (#) 
vhe random process X {t) 15 evidently a pure birth process with a finite 
number of states n whose graph of states 1s shown in Fig 1036 To 
find the intensity A; (f) (& -— 0 1 n — 1) we assume that the 
nracess 18 in the states, By definitien the nrahability of this assump 
tion 1s p, (f) Provided that the assumption 1s satisfied the intensiy 
of the flow of new (not yet 2n the directory) terms 1s 


ay (t) = 4 (2) 2" =A (1 -—) 





Ch.'10. Flows of Events. Markov Processes 364 


The differential equations (10.0.24) and (10.0.25) assume the form 
. k nx (t) b(t) | 
ins S(t) (1—=) py (t) = a(t) - TE» (10-36-41) 
k=0 


d Var MS [A (2) (1——] + 2kv (t) (1——=] 


h=0 


2m, (t) 4 (t) (1-45) | PA 
_ A(t) —2 (t) SES — 2d (2) Nats (10.36.2) 


Let us solve these equations for the simple case when 
1. (t) = = const, m= const, mz, (0) = Var (0) = 0. 


rN 
m.(f)=n(i—e ™), limm, (i) =" (10.36.3) 
{-c 


my. 4 --—t 
Var, (f)=n(i-—e " ye 7 =m,(t)e * ; 
lim Var, (¢) = 9. (10.36.4) 


{co 


Note that the function m, (t) Increases monotonically, tending to 7” 
in the limit, whereas the function Varx (é) is zero fort = 0 andt—> © 
and attains its maximum for a certain value of tm which can be found 
from the condition dVar,(é)/dt =O (> QO). 

Hence 


A 
O5=e 7 —> ty x 0.7TnIlh. 
Por this value of t,, the maximum variance max War, (t) © 
n(L — e707) e-0.7 = n 0.25, Ox (tm) = 9-9 Vn, and the maximum 
value of the coefficient of variation Ox (bin) / 12 (tm) = 1/V n. 

If we know the intensity 4 of the flow of terms to the directory 1n the 
records arriving at the data bank and the total number of terms 7, 
then we can determine, with a sufficient accuracy, the average time 
fi necessary to fill 95 per cent of the directory, i.e. 1 —e m fill 
0.95, whence tri ae on/h. 

If x is unknown (which is a frequent occurrence in practice), we can 
lind the estimate n of the quantity 7 as follows. We determine the actual 
numbers of the accumulated terms in the directory 77%, Mo, -- +1 My 
at each moment 71, Te, Ts: °° >. U (T; << Ti-41)- We assume these 
quantities to be approximately equal to the average quantities of accu- 
mulated terms: m; = n (1 — e-At™) (i= 1, 2, -- +2 2). Solving 
this equation for n, we find 2 values 7%, Ma. ++ n, for the correspond- 
Ing pairs of values: (7m, 71), (72> To)y cy (My T)- We estimate 


2 from the formula 
I 


7 n;)/L. 


i= 
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10 37. Tor the conditions of the preceding problem find the time 4.) 
needed to fill the directory by 95 per cent and the probability that after 
twa years of accumulation the directory will contain less than 90 per 
cent of all the possible terms 1f the total number of terms » = 100000 
a total of 100 O00 records are fed into the data bank per year and each 
document contains an average of 1 5 terms 

Solution We find the intensity of flow of terms per record fed into 
the data bank per annum 


7 = 100000 «x 15 = 150000 t/y,ear 


We can find the quantity ty from the expression tr = 3 n/} = 
3% #400000/150 000 = 2 years To find the probability that after 
two years of accumulating terms the directory will contain no fess 
than 90 per cent of all terms, 1 1s first of all necessary to find m, (2) 
and Var, (2} [see formulas (10363) and (103604)] m, (2} = 
100 000 (1 —e '5*2)=095 « 100000 = 95 000 Var, (2) = 
95000 x 005 = 4750) 6, (23) = $89 

Note that the maximum variance Var, (f,,) = 0 25n = 23 000, 
oy (fm) = 158 

Alt the moment f = 2 ye1rs the number of terms in the directory 18 @ 
random variable A (2) which 1s approatmately normally distributed 
with the characteristics obtained above Therefore, P {X (2) > 
On} 1 since m, — 30, > 0 9n 

10 38 We consider 1 more genera] case for the operation of a data 
bank directory The first complication as compared to the hypothesis 
of Problem 10 36 1s that the maximum number of terms nim the direc 
fory 18 not constant but 1 function of time ¢ a” ét) (in the case of a di 
rectory of the names of orginizations this means that the total number 
of organisations varies with time increasing or decreasing) 

In addition, at some point in time a term fed into the directory 13 
deleted Irom it because the term becomes chsolete It 1s assumed that 
the flow of deletions 1s 1 Poisson process with intensity uw (f, which 
is the same for all the terms in the directory 


In that case the intensities of the birth and death flows have the form 
—_ —_ ft — a 
(=F (t)(1— Sa) palt)=p (eh, (40 3844) 


and equations (10 0 24) and{(10 0 25) assume the form (the relations 


of the function m, (t}, Var {0 2 (0,34, pw , t} and time é are 
onutted for the sake of brevity) (t),32 (2), p(t), pa ( 


dm/dt = i — m, (A/n + u), 
dVar,/dt = 4 — my (Mn — p) —2 (Mn +p) Vary. = (10 38 2) 


ii the quantities }, m, p are constant (do not depend on time), then, 


as { — oo, Stationary conditions are possible for which dm,/dt = 
dVar,/dt = 0, whence “y 


= 


monn (tae) 





; Var, =m, (4 {. x ". 


Lin 


CHAPTER 11 


Queueing Theory 


11.0. A queueing system is one designed to serve customers (demands) arriving 
at random moments. Examples of queueing systems are a telephone exchange, 
a garage, a booking-office, a hairdresser’s, an interactive computer system. Queueing 
theory deals with the stochastic processes taking place in queueing systems. 

A facility which serves customers (demands) is called a server (channel). There 
are single-server (one-channel) and multi-server (multi-channel) queueing systems. 
A booking-office with one man at the window is an example of a single-server SYS- 
tem, while a booking-office with several men at the windows is an example of a 
multi-server system. 

We also differentiate between congestion systems (systems with refusals) and delay 
gueueing systems. A customer arriving at a congestion system when all the servers 
are busy is refused service and departs without taking part in any further proceed- 
ings. Ina delay queueing system, a customer arriving when all the servers are busy 
does not leave the system but joins the queue and waits for the server to become 
free. The number of places m in the queue may either be limited or unlimited. Ii 
m= 0, a delay system turns into a congestion system. A queue can be bounded 
both in terms of the number of customers in it (the size or length of the queue) and 
in terms of the queveing time (systems of this kind are known as “systems with 
impatient customers”). 

Delay systems are also subdivided in terms of the queue discipline, 1.€. custo- 
mers may be served either in the order of arrival or in a random order, or some 
customers may be able to obtain service before others (a priority service). A priority 
service may have several gradations, OF ranks of prontos. 

The analytic investigation of a queueing system can be performed in a simplest 
way when all the flows of events transferring it from state to state are elementary 
(stationary Poisson’s). This means that the time intervals between the events in 
the flow have an exponential distribution with a parameter equal to the intensity 
of the corresponding flow. For a queueing system this assumption Means that both 
the arrival process and the service process are stationary Poisson’s. We use the term 
service process when the arriving customers are served one alter another by one con- 
tinuously busy server. This process Is stationary Poisson's only if the service time 
ofa customer TJsor is a random variable which has an exponential distribution. 
The parameter pb of this distribution is an Inverse of the average service time: 


I! = i/tser, Whete fser = M (Tcer]. Instead of saying “the service process is sta- 
tionary Poisson’s” we can say “the service time is exponential”. In what follows we 
shall call, for brevity, every queueing system in which all the processes are station- 
ary Poisson’s an elementary queueing system. In this chapter we shall mainly deal 
With elementary queueing systems. 

If all the flows of events are stationary Poisson’s, then the process in a queueing 
system is a Markov stochastic process with discrete states and continuous time. 
When certain conditions are fulfilled, a limit stationary state exists for this process 
in which neither the probabilities of the states nor the other characteristics of the 
Process depend on time. 

The problems the queueing theory deals with include finding the probabilities 
of various states of a queueing system and establishing a relationship between the 
parameters (the number of servers ", the intensity of the arrival process A, the dis- 
tribution of the service time, and so on) and the characteristics of the efficiency of 

¢ service system. For example. we can consider: a 
; the average number of customers A served by a queueing system per unit time 
t the absolute capacity of the system for service; 
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the probability of serving an armving customer @ or the relative capacity of 
the system for service @ = A/sA 
the probability of a refusal Pyar 1 e the probability that an arriving customer 


will not be served Pp. = i1-—@ 
the average number of customers present in a systeth (being served or in the 


queite) z _ 
the average number of customers in the queue r 
the average waiting time of a customer (the average time a customer is present 


in the system) fy 

the average queueing time of a customer (the average tima a customer spends 
in the queue) fy _ 

the average number of busy servers A 

In a general case all these characteristics depend on time But many service 
systems operate under the same conditions for a sufficiently long time and there 
fore a situation close to stationary is established Withont speerfying it every time 
we shall everywhere calculate Limiting probabilities of the states and the l:miting 
characteristics of the e[fciency of a quenemg system with respect to its limiting 
Steady state operation 

For any open*) queueing system operating under limtting stationary conditions 
the average waiting tame of a customer f£, 19 expressed in terms of the average num 
her of customers im the system by Little s formula 


fu, = 2fh, {if 0 1) 


wbere Ais the intensity of the arfival process 
A similar formula (also known as Little s formula) relates the average queuelog 


time of a customer é, and the average number r of customers in the queve 
tg ora. (11 0 2) 


Little s formulas are very useful since they mahe it possible to calculate one 
of the tuo characteristics of the efficiency {the average queveing time for a customer 
and the average number of customers) without necessarily calculating the other 

It should be emphasized that formulas (11 01) and (11 0 2) are valid for any 
open queueing system (single server multi server and for any kind of arrival and 
service process) the only requirement being that the arrival and service processes 
muct be stationary 

Another very rmportant expression for an open quevemng system 13 a formula 


which expresses the average number of busy servers A in terms of the absolute 
capacity of the sy«tem for service A 


Aes Adu ~ (11 0 2) 


where [t = 1/fserp 18 tha intensity of the service process 

Many problems in queueing theory concerning elementary queueing systems 
can be solved using a birth and death chain (see Chapter 10) Ef the directed graph 
of states of a queueing system can be represented a3 in Fig 4104 then the limiting 
probabilities for the states can be expressed by formulas (100 23) 1¢e 


he « Anh hh | hgh An 1 |7! 
P {i+ —T ie fof __fn1 } 
. it + Ha Fs + + [Hy }tq ER + 7 Hy} ry 
poke pp pe btn 
spy , by Hs Pa 





*) A queueing system 1s said to be open if the intensity of the arrival process 
does not depend on the state of the system itsell, 
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— ee ee ee 0O< k<sn), *#eng 
Pk [4 flo ye Lp Po ( — — ) 
a ee 
= +. op 14.0.4 
Pn Uyia --- Hn Po ( ) 


When deriving a formula for the average number of customers (in a queue or 
ina system), we often use the technique for dilferentiating a series. Thus if 
z<i, then 


OO oo OO 
d d |; ne x 
k— S —- xk = 7 —— k= 
py Be ae ape 2 OS" Tn Tor —ap ’ 


and finally 


2 kah= ae (41.0.5) 
h=1 


Below we shall present without proof a number of formulas for the limiting 
probabilities of states and the characteristics of the efficiency for certain often en- 
countered queueing systems. Other examples of queueing systems will be con- 
sidered in the form of problems. 





Fig. 11.0.1 


i, Anelementary congestion system (Erlang’s problem). Consider an n-server 
system with refusals at which customers arrive in a stationary Poisson process with 


intensity 4; the service time is exponential with parameter p == 1/tser. The states 
of the system are numbered in accordance with the number of customers in_ the 
aa (since there is no queue it coincides with the number of busy servers). Thus 
ave 

Sy—the system is idle: 

s;~One server is busy and the other servers are idle; ...; 

Sp~—k Servers are busy and the other servers are idle Qik<snj.e-3 

Sn—all n servers are busy. 

The limiting probabilities of states are expressed by Erlang’s formula: 


= p , PF po? )~4 | 
p={14+$-44- ew a 


h 
Ph=Te Po (RHA y w0e 2s (11.0.6) 
Where D=2/u. 
The characteristics of the efficiency are 
A=(1—ppy), Q=1—Dnp, Pref==Pn, k=p (14—Pn). (11.0.7) 


For large values of n it is convenient to calculate the probabilities of states giv- 





en in (11.0.6) in terms of the tabulated functions: 
Pim, Fea -a (for a Poisson distribution) (41.0.8) 
m] 
and 
i R 
ad 
Rim, a= >» x e7a (41.0.9) 


k=0 
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{sce Appendices f and 2) the first of which can be expre*sed 1m terms of the second 


Pim, 2)= Ar ah} — Rim —i a) (110105 
Using these functions we can rewrite Erlang a formulas (11 0 6) in the form 
Ph=P(k p¥YRin p} (k= O,1 2... 4) (11 0 44) 


2 An elementary single server system with an unbounded queue Consider 
a single server system at which customers arrive in a stationary Poisson process 


sith intensity A The cervice time 13 etponential with parameter = Aftcep The 
length of the queve 1s unlimited The iimiting probahilrties exist only for p 
Aj acd {for pci the queue imereates indefinitely) The states of the system 
are numbered in accordance with the number of customers who are in the queue 
or being served Thus 

sg—-the system 1s idle 

s;—the server 15 busy and there 1s no queve 

s,--the server 1s busy and one customer is waiting to be served , 

s,—the server ts busy and A — 4 customers are in the queue 

The limiting probabilities of states are expressed by the [formulas 


=i1i-—p pr-—prti—p) (&=1 2 ) (11 0 12) 


where p = A/p <1 
The characteristics of the eliiciency of the system are 











A=h O=1 Prey <0 (440 13) 
_ op _ pt -~ =p 
a= Top OT Gap FY Gp} 
_e (44 0 14) 
ahd p) 


and the average number of busy servers (or the probability that the server 1s busy) 1s 
A= A/p = 0 (11 0 45} 


2 Anelementary «ingle server system with a Lounded queue Consider a single 
server Queueing sjstem at which customers arrive in a stationar} Poisson process 


with intensity A the service time 1s exponential with parameter pt = A/tger There 
are n Places in the queue [Ya customer arrives when all the places are eccupied 
he 1s refused service and departs The states of the system are 
sg—the system 15 idle 
s,-~the server 18 busy and there 1s no queue 
s,——the server 1s busy and one customer 1s im the queue 
s,—the server 1s bus} and 4 — 4 customers are im the queue 
Sm+i~—the server is bus} and m customers are 1m the queue 
The limiting probabilit es of states exist for amy p = A/p and are 
4. 
Poot Ph==phpg (kK=1 «., m+1}, (11 0 16) 


The characteristics of the efficiency of the system are 
A=AQ — Pm) O=1—Ppman  Prer ~ Pmes 
The average number of busy servers (the probability that the server 1s busy) 1 


,{=1—p, aq¢ury 
The average number of customers in the quete 
r= Pio (m+ i—mpi) (11 0 18) 


(i— prey (i—p} 
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he average number of customers in the system 
zeo=rtk, (14.0. 19) 
By Little’s formula 
tw=2/Ay tqg=r/d. (14.0.20) 


4, An elementary multi-server system with an unbounded queue. Consider an 
n-server queueing system at which customers arrive in a stationary Poisson process 
with intensity A; the service time of a customer is exponential with parameter 
t= f/tger. Limiting probabilities exist only for p/n = x <1, where p = 2/p. 
The states of the system are numbered in accordance with the number of customers 
in the system, hence 

Ss—the system is idle; 

sone server is busy; ...; 

Sp—k servers are busy 1 <k <n);... 1 there is no queue 

s,—all n servers are busy; 

Sna37-4))_n servers are busy and one customer is in the queue; 

Snep—all tne n servers are busy and r customers are in the queue. 

The limiting probabilities of states are given by the formulas 


n N+1 4 ~4 
p={itt+...t+o5 \ 


nen} 1-—-x J 





Nt+Tr 


h 
P= ay Po (SES) Pasr= Tey Po (ret). (140.21) 


Using the functions P (m, a) and R (m, a), we can reduce (11.0.24) to the form 





P (k, 
P= SB) (k=O, oe, 
R (n, p)-EP in, p) (z=) 
(414.0.22) 
Pray =X" Pn (r=14, 2, eosle 
The characteristics of the efficiency of the system are 
r==p™1p/{n-nl (A—x)2] = x%py(1—x)?; (1.0.23) 
z==r+k=r-toy (14.0.24) 
tw=2/\y tgar/h (41.0.25) 


Py elementary multi-server system with a hounded queue. The conditions 

eye numbering of the states are the same as in item 4 except that the number m 

a aces In the queue is limited. Limiting probabilities of states exist for any A 
} and are expressed by the formulas 


_ e o7 ort 4 — ym \"" . 
po={1-+7-+ eee teat nen) 1—4 


oR 
Pk=F7 Po ({4<k<n); 


prer 
Pret = ey Po (i<r<m), (14.0.26) 


Where » — O/n =) (nn) 
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The characterstics of the efficiency of the system ate 


A=A(l—paam) G=1—Pnim Pret Poem k=p (1 “~ Pnem}) (ii 0 27) 


~ n+l i 434m m+) 
garrth (44 6 295 
fqerik ty == a/h (11 0 30) 


fi multi server congestion aistem for a stationary Poisson arrival and an 
arbitrary service time Erlang 3 formula (11 0 6} remains valid io the case when 
the arrival process is stationary Poisson 3 and the service time Teer hag an ari 
trary distribution with expectation fger = 1441 

7 A single server system with an unbounded queue for a stationary Poisson 
arrival and an arbitrary service time If the arrivals at a single server queueing 
system come ina stationary Poitson flow with intensity A and the service time Per 
has an etponential distribution with expectation i/fe and the coefficient of varia 
tin vw, then the average number of customers in the queue 1s etpressed by the 
Pollaczekh AAinehine formula 


r= (L + eypl2 (1 — pil (11 0 34) 
where p = A/w and the average number of customers in the svstem 
Z= (+220 — ol) +e (11.0 32) 
Using Littles formula we get fram (119 34) and (14 0 32) 
fg Pht ty? pre eek 1033 
‘a= 2h (i — p) 24 (1—p yt” “ 


§ Asiogle server queueing system for an arbitrary (Patmj arrival process 
and an arbitrary service time There are no exact formulas for this case, and an 
approximation fer the len¢cth of the queue 1s given by the formula 


rae pt (vy + v2)/[2 (1 — p)] (i 0 34) 


where py 13 the coefficient of variation of the anterarrival ime, p = Mu 445 the 
inverse of the expectation of that time pt = 4/tse, 19 the inverse of the average 
service time 2, 18 the coefficient of variation of the service time The average num 
ber of customers in the queueing system 


Fe (p (of + vgv/l2 ad — p)l} +P, (11.0 39) 
and the average queueing and waiting times of a customer are 
fg pet + w2V/[2d (L — ph, (14 0 36) 
and 
Tae fp? (62 + v2 (1 — py} + Aly (11037) 
respectively 


9 Anclementary mult; phase delay system It is difficult to analyse multi 
phase quetleineg systems in the general case since the arrival protess of each succes 
sve Phase is the departure process af the preceding phase and there are al tereiects 
in the geceral cise However if exsfomers arrive fn a sfatianary Porson process af 
a queueing system uith an unbounded quewe and ihe service time ts exponential then 
the denarture process ig stationary Poisson s with the same intensity A as the atria 
it follows that a mult. phase queueing system with an unbounded queue before eat 
phase a stationary Poisson arrival and an exponential service time at each phase 
can be analysed aa a simple sequence of elementary queueing systems 
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If the queue before a phase is bounded, then the departure from that phase is 
o longer stationary Poisson’s and the above technique can only be used for ap- 
proximations. 

In what follows we shall use the notations for the efficiency characteristics as 
given on pp. 363 and 364, but we shall introduce new ones when needed. When we 
define the density f (x) on the x-axis, we shall not indicate the values of f (x) on 
the boundaries of those parts. 

If the unit of time is not fixed, we shall designate, for brevity, the intensities 
of the processes simply by letters, e.g. 4, w, ... (without indicating the dimen- 


sions). The same refers to the time tw and tg. Nowif the unit of time is fixed (a min- 
ute, an hour, a year, etc.), we shall indicate the units of measurement. 

Rather than using a distribution function J (¢) it will be more convenient in this 
chapter to write the distribution of a mixed random variable 7 as a “generalized” 
density f (f) which is defined as 


f(j=F, (t)+ Di pid (t—2)), 


where F’ (t) is the derivative of the distribution function on the intervals of its 


continuity, p; = P {7 = 7;}, and 6 (z) is the delta-function whose properties are 
given in Appendix 6. 


Problems and Exercises 


11.4, Consider a single-server congestion system at which customers 
arlve in a stationary Poisson process with intensity 4, the service 
lime being exponential with parameter uv. At the 
intial moment ¢ = O the server is idle. Construct A 
the marked graph of states for the system. Write | 5 Ty | 
and solve the Kolmogorov differential equations 
for the probabilities of states of the system. Find 
tte limiting probabilities of the states and (for Pig. 11.4 
Steady-state conditions) the characteristics of the 


efficiency of the queueing system, i.e. A, Q, Pres, &. 

Solution. The states of the queueing system are: Sp, it is idle; s,, 
the server is busy. The graph of states is shown in Fig. 11.1. The Kol- 
Mogorov equations are 


ap! di = ~—APpo Lt UPy, dp,/dt = MP o —— [tPy. (11.1.1) 


, Since Po+ p, =1 for any t, we can express p,; in terms of po, i.e. py = 
—~ Po, and get one equation for Dp: 


dpoldt = —(A + tt) Po + (14.1.2) 
Solving this equation, we get p, as a function of f: 


A a- t 
Po(t)= ar jite Germ |, 





hence 
A 
P4 (t) = 1 — Po (t) — RE f{—e-twey, 


When 7? —» co, we get limiting probabilities, viz. 


Po=w(A +), Py = AMA + Br). (11.1.3) 


{4~ 9575 
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We can find them much more easily by solving algebraic linear equa 
tions fer the lamiting probabilities of states 


APp = BP) Pot Py = 1 


We can rewrite formulas (11 1 3) in a more concise form if we intro- 
duce a designition p = A/p 


Po = 1/4 +p) Pr = pA(L + p} 
The charrctertstics of the efficiency of the queueing system are 


re | 
ae 7 a ec Te 


£12 Given 1 telepl one line which 1s a single server congestion sys 
tem calls arrive at ts input in a stationary Poisson proce s The traffic 
intensity is A — 04 calls per minute The average duration of a con 
versation f.., = 3 min and has an exponential distrrbution Find the 
limiting probabilities of the states of the system p, and p, as well as 
A @ P,.- and A Compare the capacity of the system for service and 
its rated capacity if each conversation lasts exactly three minutes and 
the calls arrive regularly one after another without a break 

Solution A—O4 p— tt eor = 1/3 p=Afu=12 By formulas 
(144495) po 1/22 ~0455 py w0545 Ow 0455 A= AO 
0182 k=p, #0545 

Thus on the averige tle telephone line will serve 0 455 calls 1¢ 
0 182 calls per minute The rited capacity of the server would be (if 
the calls arrived and were served regularly) Asat. = iftee, = {/3 & 
0 333 callsfmin and that is almost twice as large as the actual ca 
pacity A 

113 We are given a single server congestion system with customers 
arriving in 4 stationary Poisson process with intensity 4 The service 


tser tsey tser 
—_*__-,, 
i ty - ts ls Z : 
Fig 11.3 


lime is nonrandom and is exactly too. = 1/u Find the relative and 
absolute capacities of the system for service in the limiting stationary 
state 

Solution Let us consider a stationary Poisson arrival process with 
intensity Aon the f axis (Fig ff 3) We shall denote ail the customers 
who are served by circles Assume that a customer who arrive 
at the moment 4 is being served Then all the customers 
who arrive after him during the time tee Will not be served The next 
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to be served will be the customer who arrives at a moment ¢, such that 
t, — t; > fer Let us consider the interval 7 between the end of the 
frst customer service period and the moment ?, the next customer to 
be served arrives. Since there are no aftereffects in an elementary flow, 
the distribution of the interval 7’ is the same as that of the interarrival 
lime in the general case, i.e. exponential with parameter A. The average 
length of the interval T is m, = 4/h. : 

Thus nonrandom busy periods of the server (t,., = 1/u long) and 
random idle periods (average length 1/A) will alternate on the t-axis 
A fraction of all the customers 


‘fu = i 
t/etdjA 7 A+B’ 


will fall on the first intervals and a fraction 
u/(A +p) = 1/1 +p), where p = A/u 


wil] fall on the second intervals. The latter quantity is the relative 
capacity of the queueing system for service 


Q = 1/(1 + 9), (41.3.4) 


whence 
A=iO=NM(i1 + 0). (11.3.2) 


Note that formulas (44.3.4) and (41.3.2) coincide with (11.1.4), which 
‘orresponds to the exponential distribution of the service time. And 
this is natural since Erlang’s formulas remain valid for any distribution 
of the service time with the mean value equal to 4/n. 

11.4. Using formula (44.0.5), prove that for an elementary single- 
“erver system with an unbounded queue the average number of cus- 
lomers being served is z = o/(1 — ), where p = A/p, and the average 
Number of customers in the queue is r= o*/(1 — p)}. 
rea By formulas (11.0.12) pp = 1—p, pr =p" (1 — 9) 
= designate the actual (random) number of customers in the sys- 

as Z: 


z= M [Z}= > kPe= 3 ko (1 —p) = (1—p) 2 kp*. 


By formula (11.0.5) for p< 1 
= Ol 
Dd ke" = (1—p)* ° 
k=1 


— z= o/(1 — p). The average number of customers in the queue 
: * Minus the average number of busy servers & = A/a = A/p = 9, 


24 
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4i5 A railway shunting yard is a single-server queueing system 
with an unbounded queue at which trains arrive in 1 stationary Poisson 
process The traffic intensity 13 A = 2 trains per hour The service time 
(shunting) of a train at the yard has an exponential distribution with 


mean value t,.. = 20 min Find the limiting probabilities of states of 
the sjstem, the average number z of trains at the yard, the average 
number r of trains in the queue the average waiting time te of a tram 
and the average queueing time ?, of a train 

Solution 4 = 2 trains/h te, = 1/8 h pp = 3 trams/h, 9 = A/p = 
2/3 By formulas (11012) we have pp =1—~— 2/3 = 1/3 py = 
(2/3) (4/3) = 2/9 p, = (2/3) (1/3) = 4/27, » Pr = (2/3) (1/3) ete 
By formulas (11018) and (41 0 14) 2 = p/(1 — p) = 2 trains, r = 
4/3 trains t, = 1h and t, = 2/3 h 

1146 The hypothesis of the preceding problem 1s complicated by the 
condition that no more than three trains can be present simultaneously 
in the shunting y1rd (including the train being served} [f a train 
arrives at a moment when there are three trains at the yard, 1t has to 
join the queue outside the yard on a side trach The station has to pay 
a fine of a roubles per hour if a train stays on the side track Find the 
average fine per day the station has to pv for trains staying on the 
side track 

Solution We calculate the average number of trains 2,,3, on the 
side track 


Zstae = 1 Pot 2py+ = 2 APe— Qe Kp*Po= Po 21 hp", 
oo . oo F a Le) a —_ a oo te 
di te =p Dd ae =p Di qe =e gy De 
Aad beh Ai k==4 
— py 2 Pt Pt a3 
Ode ip ap? 
- ~ 14-3 
t= Po Dy Apt =f RP wt 18 
k= h 


_ By Little s formula the average time a train stays on the side track 
tae oe 118/2 = 1118/2 = 059 h On the average 24 A = 48 trains 


amie at the station every 24 hours The average daily fine 1348 x 0 BI ae 
a 

i117 Using the birth and death scheme, calculate directly from the 
directed graph of states the limiting probabilities of states for a simple 
two server queueing system (nm = 2) with three places in the queue 
(m = 3) for A = 06, p= 02 and p = A/u =3 Find the character 
istics of this queueing system 16 2, Fr ‘tes ‘ta without using formulas 
(22.026) proceeding rather from the limiting probabilities, and com 
pare the results with those obtaimed from (14 0 26) 


t 


t 


eel ~*~ 
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Solution. The directed graph of states of the queueing system is 
shown in Fig. 14.7. Introducing the designation A/p = p, we get the 





Fig. 141.7 


following, using a birth and death chain: 
2 3 4 5 \-1 a ee _ 
n=(ite+ +o tate J = (40.58)"t ~ 0.025, 


3 ‘ard 4.5 saat — 6.75 tes G5 
=p ag © 0.074, Po=- 40.58 ~ 0.141, P3758 zw 0.41 om 








10.45 1548 9g 97 
Ps "70.58 2.250, Ps 7058 ~ 0.379; 


71% 0.074-42 X 0.11143 x 0.16544 x 0.200 + 5 x 0.37573.67, 
me 1X 0.165 +2 x 0.250 +3 x 0.375 & 1.79, ty = 2/0.6 ~ 6.14, 
£,=7/0.6 ~ 2.98. 





{1.8. The formula for 7 (14.0.28) is valid for any *< 4 or % > 1. 
For x = 4 it is no longer valid, yielding an undetermined value 0/0). 


A A A A A Rh 
ae ae Saale Sed 
a op hfe nye nye ft 
Fig. 11.8 


Directly from the birth and death chain derive the probabilities of the 
Slates Dy, Di, -- +) Pn+m for this case and find the efficiency charac- 


teristics of the queueing system, i.e. A, QO, Prets By Ty 21 bay bw: 
Solution. The directed graph of states of the queueing system has 
the form shown in Fig. 11.8. Using the general formulas for the birth 
and death scheme and designating A/p =, We obtain 
ont ontm —4 


_—f4, 8 1 pF 4 os 
Po {1+ roto teeta neni a ee n™.n!} 
= Pp , em Pe fh \P4 Ud | Sai 
(14 P peel E+ (4) pet (4) i 
For x = o/n = 4 
See ee oe fe} (11.8.4) 
P= itary ro a foal 
k ris 
Pr=-S- Do (A<k<n), Patr= "7 Po ({4<r<m), (11.8.2) 


ye er 
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FI 
Pret = Pasm O= 1 Duame= 1 — ~~ By 


rn] 


A=1Q=1| 1 — Po | ‘ k= Alp=p| 4 — S po| ' 


Tt | id 

~ er — 2" mmf} 

r= Dy Paar = Qe Po Po 2) nl 5} Po: 
T=1 =f r=t 


zor+k, ty=2/h, ‘tq rth 
119. A petrol station has two petrol pumps (m = 2), but its forecourt 
can only hold four warting cars (m= 4) The arrival of cars at the station 
1s Stationary Poisson's with intensity A=1 car/min The service time 
of a car 1s exponential with mean values t,., = 2 min Find the limit- 
ing probabilities of the states of the petrol station and 1ts characteristics 
A, 0? Peer koa, Tf, bays to 
Solution 4 = 1 w= 4/2 =05, p=2, x=oln =1 From for 
mulas (11 8 4} (1183) we find that 


92 93 4ynd 
po={1+2+a+57 4} = aR 


(11 83) 


2 
Pi = Pa= Pa P= Ps Pa 75 
Pret = 2/13, Q=1— Pry = 113, A= 1Q = MAB 
_ ex 0 85 cars/min, 
A = A/y = 22/13 ~ 169 pumps, 


pa ARS A - - 5, 
r= 2 az 1 54 cars, Z= rh we 3 23 cars 





1110 Customers arrive at a two Server congestion system at a rate 
of } = 4 customers per hour The average service time #,-,, = 98 b 
per customer The income from every customer served c = 4 roubles 
The upkeep of every server 1s 2 roubles/h Decide whether it 1s advan 
tageous to increase the number of servers to three 

Solution By Erlang’s formulas (14 0 6} 


2% \-3 5 12 
po= {143 2455} = (9 82710107, pre By 0 550, 
@=1—p, +0450, A= 40 ~18 customers/h 


The income from the customers in the given varrantis D = At 
72 roublessh 


We calculate the same parameters for a three server queverng system 
fdenotine them Jy primes) 


po= {1439438 1 3 V-'2 00677, pha 5 48x 0 0677~0 Si, 
QO’ = 1-—- p, w0,629, A’ = 40° w2 52, 


D’ = A’ «¢ w~ 1008 rowbles/h 
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The increase in the income is D’ — D = 2.88 roubles/h, while the 
increase in the cost of the upkeep is 2 roubles/h. It can be seen that the 
transition from m= 2 to nm = 3 is economically advantageous. 

11.41. We consider an elementary queueing system with a practi- 
cally unlimited number of channels (n—- oo). The demands arrive with 
intensity 4 while the intensity of the service process (per channel) is u. 
Find the limiting probabilities of states of the system and the average 


number of busy channels &. 

Solution. This queueing system is neither a congestion nor a delay 
system, but it can be regarded as the limiting case for a system with 
telusals for n + co. Erlang’s formulas (41.0.6) yield 


<1 pk i iy ee 
Po={ 2) £-}" =e-9, where pers Pr= ye =P (ky 9) 
k=0 


: Appendix 1). For an infinite number of channels A = A and k = 
v Ly = 0. 

11.12, We consider a single-channel congestion system to which 
demands arrive in a stationary Poisson process with intensity 4. The 


service time is exponential with parameter p = oo The operating 
channel can fail from time to time (refuse), the failure process being 





X-service process fe 


© -refusal process Vv 
(8) 
Fig. 11.12 


Stationary Poisson’s with intensity v. The reconditioning (repair) of 
achannel begins immediately after it fails, the time of repair T, being 


€xponential with parameter y = 1/t,. The demand which was being 

setved at the moment of failure departs from the system unserved. 
Find the limiting probabilities of the following states of the system: 

‘0 the channel is idle, s,, the channel is busy and in working order, s. 
oe is being repaired and the characteristics of the system are 

n 
Solution. The directed graph of states of the queueing system is 
given in Fig. 44.42a. The algebraic equations for the limiting proba- 
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bilities of states are 
APo = PPL + YP, (E+ ¥) Pi = Por VP, = Pa» (LE 12 4) 
they ate summed with the normilizing condition 
Pot Py tPpe=i (14 12 2) 
We express the probabilities p, and p, from (11 12 4) 1n terms of p, 


4 a ee 
ayy Po P= 7 PAa= Tp 0 
Substituting p, and p, into (11 12 Z), we get 
po = (1 + Adm +) + Av/fy (te + vp} (44 12 3} 


To find the relative capacity for service Q@, the probability p, that 
the demand will be accepted for service must be multiplied by the con- 
ditional probahnlity p that the demand which 1s accepted for service 
will actually he served (the channel will not fail during the service 
time) ‘We shall use the integral total probability formula to find the 
conditional probability We advance a hypothesis that the service time 
of a demand has fallen on the intervil from ¢ te t + dt, the probability 
of this hypothesis being approximately f/ (} dt, where f (f} 15 the dis 
tribution density of the service time, re f (#) = pe"! (t 0) The 
conditional probability that the channel will not fail during the time ¢ 
is e ¥f hence 





= ji -*vi _ ~(p+vE = a 
p jn o-¥! dt | He dt rear 


This conditional probability can be found much more easily 1t 8 
equal to the probability that once it has begun, the service procedure 
will be completed before the channel fails. We superimpose on the ¢ avis 
(Fig 14 125) the two processes, viz the service process with mntensity pe 
{denoted by crosses} and the refusal process with intensity v (denoted 
by circles) We fix a point ¢ on the ¢t axis and find the probability that 
the first cross following the fixed point will arrive earher than a circle 
It is evidently equal to the ratio of the intensity of the flow of crosses 
tg the total mtensity of the flows of crosses and circles, w/(w + ¥) 

us 


—=ppr={i—_t Ce ss A S » 
G PoP ( wy hi (1 Tt uy + 4 ( [b= ¥} ~ pmb vebaA (t+ v/P) / 
A=0. (14 12 4) 


44.13. The conditions of Problem 11 42 are repeated with the only 
difference that the channel may fail during an idle period too (with 
intensity wv <2 v) 

Solution The directed praph of states of the queueing system 38 
shown in Fig 11413 From the equations 


(A + v"} Po = wp, + WDe, (t-bV) Py = AP, YPo = VAL V' Pos 
Pot Pr + Py =1 
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we find the limiting probabilities 
_ h Awe’ + vv’ jot 
po= {4 + greet pry j 


nN _ Av - wv’ + vv! 
Pi= Wry, fo Poa= u--v Pos 








~ pL _40— 7, 
QO = Po u+v ? A=)AQ = Po pty * 


11.44. We consider an elementary single-channel queueing system: 
with a limited number of places in the queue, m = 2. The operating” 





Fig, 11.13 Fig. 11.14 


channel may fail (refuse). The demand being served at the moment 
of failure joins the waiting line if there are unoccupied places, and if 
there are no places it departs unserved. The intensity of the arrival 
Process is A, that of the service process is }I, that of the failure process. 
of the channel is v, and that of the reconditioning (repair) process is ¥. 
Enumerate the states of the system, find their limiting probabilities. 
and determine A, k, 7, 2, ty, tgfor’ = 2, = 4,v = 0.5 and y = 1. 

Solution. The states of the system are: 

Sop—the system is idle, the channel is in working order; 

Si>—the channel is busy and in working order, there is no queue, 

S—the channel has failed and is being repaired; one demand is- 
Wailing to be served; 

Se>—the channel is busy and in working order, one demand is being: 
served and another one is waiting to be served; 
8 —the channel has failed and is being repaired; two demands are: 
In the queue: 

S3>—the channel is busy and in working order: two demands are in 

€ queue and one demand is being served. 

he sraph of the states of the system is shown in Fig. 11.44. The 

equations for the limiting probabilities of states are 


Pio = APoo. PP2o + VP11 + poo = (Wo h -+ ¥) Pro 
MPs + YPe1 + APio = (uu +h + V) Poor 
APoo == (+ Vv) Pso: VP20 = (ue +> v) P30: 
Vig = (p +A) Pur AP + VPoo + VP3s0 = YPa1: 
Poo + Pro + Pur + Peo + Poy 7 P30 = A. 


Pe eal ge i rr 


re 
* ete Genet ig eens 
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Solving these equations atA = 2 p—t v=O5andy=1 we obtain 
Poa = 3/61 0049) pry = G/GL O098 = pay = 14/04 0 230 


Hence 


z= 14 (Pro + Par) + 2 (Poo + Par) + 3pgq = 983/183 = 2 09 
r= 1 (Peo + Pr) +2 (on + Pao) — 89/61 1 46 


The absolute capacity A of a queueing system with nonretusing 
channels can be found by multiplying & by 4 In our case the productiv 
ity of one channel (the number of demands actually served per unit 
time) can be found by multiplying & by the probability y/(p + 4) 
that the service procedure will be completed te A — Ap te/(p -+ v) — 
utf( + v) we 0 42 

1145 There are three chairs (n 3) 1n an outstation dental surgery 
and three chairs tn the 1 tting room (m — 3} Patients arrive in a 
stationary Potsson process it a rate of A — 12 patients per hour The 
service time (for one patient) s exponential with a mean value t,. = 
20 min If all the three chairs n the waiting room are occupied an 
arriving pitient does not join the queue Find the average number of 
patients that the dentists serve per hour the average fractron of the 
arriving patients that are actually served the average number of occu 
pied chairs 1n the wa ting room the average waiting time f,, of a patient 
(including both the dental surgery and waiting room) and the average 
waiting time given that the patient will be served 

Solution po 12/8-—4 y= p/8 4/3 n=3 m=3 From for 
mulas (14 0 26) (11 030) we find that 


po={it4+ 54542, FOES) * 0 01218 ~ 0 012 
Pp, =4 x 008218 ©0049 pp, — 8 x 0.01248 ~ 0097 


Pp= eX 001218 0180 pyay=—te x 0 01218 0 173 
Pain > Pass oz 0 231 Pyis= Paty x 0 307 


The average fraction of patients being served 1s @ = 1 — Rye = 
1 — psi, ~f — 6 307 — 6 653 

The average number of patients served by the dentists per hour 15 
A iG wi2 x 6683 = 8 32 


_ By formula (11 0 27) the average number of busy servers (dentists) 
& = 4 (1 — psts) 2 78 
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a tite 


By formula (141.0.28) the average number of patients in the queue 


£40,01248 1—4x (4/3)8-+3 (4/3)* 456 
3X6 (4—4/3)° ~ oe 


cart hw 434, tqg=rihw 0-13 bh, ty —2/h ~ 0.362 h. 


T= 


The values of t,, and tq are small because some patients do not join 
the queue and depart unserved. The conditionalfaverage waiting time 


ofa patient, provided that he is served, isty = t,,/Q ~ 0.52 h, and the 


conditional average queueing time (under the same condition) i= 


(QQ ~0.19 b. 

146. For % = 4 formulas (11.0.26) and (44.0.28) yield an indeter- 
minacy of the form 0/0. Find the value of the ‘ndeterminate form and 
write formulas which are valid for x = 1. 


Solution. By L’Hospital’s rule 


P 4— ym —mym-1 = 
in SAE = 
0 0” ontim ms | 
pa {(ttfete tart eat , (14.16.4) 
py=ee Po (1<k<n), (44.16.2) 
pe” , 
| Pnaim= Pnt27 °°" = Prn+m~ pl Po: (11.16.3) 


ie. all the probabilities, beginning with p, and ending with Pa+m 
are equal. 

The formulas for A, Q,; Pres and & remain the same. 

Finding the value of the ‘ndeterminate form in formula (141.0.28), 


We get 
Nim tomb) em -mamet mm) pe prttpom (mT 2) | (44.16.4) 
Ko (14—x)* 2 an-n} 


Formulas (11.0.29) and (411.0.350) remain the same. 
We could derive formulas (14.46.1)-(14.16.3) without finding the 
value of the indeterminate form but using the birth and death scheme. 
A147. (1) Calculate the efficiency characteristics A, Q, Preps Ms Ts 
i, tg, t. for an elementary single-server system with three places in 
= queue (m = 3) given 4 = 4, customers per hour and toe, = A/p = 
5, (2) Find out how these characteristics will change when the number 
of places in the queue is increased to m = 4. 
ta Solution, p = 2, p = A/p = 4. By formulas (14.0.12)-(44.0.16) 

T m= 3 we have Po = 4/34, Pa = 16/31, @ oy, 0.484, Pi \Q = 
1.93 customers per hour, k = 0Q ~ 0.968, r 2.19 customers, 2 ~ 
3.16 customers, f, 0.55 h and ty 0.79 h. 


380 Applied Problems tn Probability Theary 


(2) For m = 4 we have py = 163 00158 py = 32/63 = 0 507 
O #0493 A «196 customers per hour radii customers 7 


4 09 customers ty wO0T handt, ~102h 

Thus an increase in the number m of places from threes to four leads 
to a negligible increise in the absolute (and relative} capacity of the 
system for service It does increase somewhat the average number of 
customers in the queue ind inthe system and the corresponding average 
times This is natural since some of the customers who would be refused 
mn the first variant join the queue in the second 

41418 How will the efficiency characterstics of the system in the 
preceding problem change if A and pp remain the same, m = 3 but the 
number of servers increase to n —- 2? 

Solution » = 1 from formulas (11161) and (11 162} we have 
Po ~— (ii p, ~ pps 2fll O@-— 1-2/1 = 0818 Azx 
327 customers/h 7 — 12/11 = 109 customers A = A/u wi 64 2—- 


r-+Acw2 73 customers t, ~ 0 27h and t, &0 68 h 

1119 The queveing system 1s a railway booking office with one 
window (mn = i) and an unbounded queue The man in the window Sells 
tichets to points i and 8B Qn the average three passengers every 
20 minutes arrive to buy 1 ticket to point A and two pissengers every 
20 minutes arrive to buy a ticket to & The arrival process can be con 
sidered to be stationary Poissons On the average three passengers are 
served in 10 min The service time 1s exponential Find whether limit 
ing probabilities of states of the system exist and if they do calculate 
the first three viz pp p py Find the effciency characteristics of the 
system 2 fF fy and t. 

Solution 4, - 320 O15 customers/min 4, — 2/20 = 010 cus 
tomers/min The total wrival intensity ¥—A,4 + Ag =O 25 custom 
ers/min jo 3/f0—03 customers/min and p = A/p wO B31 
Limiting probabilities do exist By formulas (11 042) (11.014) po = 
Q167 p, 0139 p, 0116 2 py ee ot 499 customers r= 
0 833 /0 167 «416 customers t, = 4 99/0 25 = 200 min and t, = 
416/025 167 min 

11 20 Asingle channel queueing system 1¢ a computer which receives 
calculation jobs The jobs arrive xn a stationary Potsson process the 
interarrival time being £ = {10 min The «ervice time 7,¢, has an Erlang 
distribution of the third order with expectation f,.. ~— 8 min Find 
the average number ¢ of jobs in the system and the average number r 
of jobs in the queue and also the average waiting time f,, and queueing 
time tg for a job 

Solution We can find the charactertstics of the system frem the 
Pollaczeh Khinchine formulas (11 0 31} and (11032) We have 4 = 
O4 jobs/min pp — 04125 jobs/min and p — Af = 08 

The coefficient of variation of the service time for Erlang s distri 


bution of the third order 1s 4/}/3 By formula (11 0 31) r = 0 64 (1 + 
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110 x 0.2) 2.43. By formula (11.0.32) z= 7 + 0.8 ~ 2.93. By 


Little’s formula t, ~ 21.3 min and ft, 29.3 min. 

(1.21. The hypothesis of the preceding problem is changed: jobs 
ative now in a Palm flow and not in a stationary Poisson flow. The 
inferarrival time has a generalized Erlang distribution of the second 
order (see Problem 8.38) with parameters r, = 1/2 and A, = 1/8. 
Using formulas (11.0.34)-(11.0.37), find approximations of the efficiency 
characteristics of the system. 

Solution. A random variable 7, which has a eeneralized Erlang dis- 
tribution of the second order, is the sum of two random variables 7, 
and 7, which have exponential distributions with parameters A, = 1/2 
and 4, = 41/8. Hence M [T] = 1/0, + 1/A, = 10 min, Var{7] = 
Var [7,] + Var [T,] = 22 + 8 = 68, v2 = 68/10? = 0.68 and vn = 
113, Consequently r = 1.62 jobs, Z = 2.42 jobs, ty = 16.2 min and 
t, = 24.2 min. 
| 11.22. A device can fail (refuse) from time to time. The refusals occur 
Mastationary Poisson process with intensity 4 = 1.6 refusals per day. 






“Ee F ey 
Fig. 11.22 Fig. 11.23 


The time needed for reconditioning (repair) Jyep has a uniform dis- 
tribution on the interval from 0 to 1 day. Find (for limiting steady- 
a conditions) the average fraction A of time for which the device is 
perating. 

Solution. The states of the device are: 5», the device is operating 
inds,, it is being repaired. The directed graph of states of the device 
is shown in Fig. 41.22, where b = 1/M [Ty ep] = 1/0.5 = 2. This 
graph exactly coincides with the directed graph of states of a single- 
cannel congestion system. We know that if the arrival process is 
stationary Poisson’s and the service time has an arbitrary distribution, 
then Erlang’s formulas (11.0.6) are valid. In this case 9 = A/p = 0.8, 
ha (1+ o/4!}-1 = 1/1.8 20.556 and p, = 1 — 0.556 ~ 0.444. 

hus F ~ 0.556, i.e. the device will operate a little more than a half 
of the time and the rest of the time it will be under repair. 

11.23. Under the conditions of the preceding problem the device has 
al exact repeater which can fail only when operating. The parameters 
-and w are the same as in Problem 11.22. Find the value of R and the 


Werage number & of the faulty devices. 

olution. The states of the system S are: 5, both devices are sound 
he is operating and the other is idle); s;, one device is operating and 
© other is under repair; s,, both devices are under repair. The directed 

Etaph of states is shown in Fig. 14.23. The graph exactly coincides with 
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the graph of states of a two channel system with refusals From Erlang, 
formulas (11 0 6) 


#>4-1 
pom {itaptgry =(14+08-+0 642} w0 472, 
p, w08X0472 = 0378, R= py +p, x 0850, 


The same technique (reduction to a system with refusals) can ev) 
dently be used when the number of repeaters 18 more than one 

{124 In a very large bookshop tle security system is such thai 
having chosen a book in 1 department 1 customer takes it to the aseistan 
who writes out an invoice The customer must then take the invoice 
to the cash desk and pay forthe invoice Having paid he can then returt 
to the selling department where the assistant checls the invoice ant 
wraps the book so that the security staff know the book 1s paid for 
The customer must therefore go through three service phases (1) col 
lection of invoice (2) payment (3) book wrapping Assume that custo 
mers arrive at a department in a Poisson flow with 4 = 45 customer 
per hour 

There tre four .ssistants to write out the invoices and the average 
Service trme /, 18 five minutes The average service time at the cashier f, 
{assume for simplicity there is one who only serves the one department’ 
and no others) 13 one minute per customer Three assistants check the 
invoice and Wrap the books the average service time ?, being two min 
utes per customer Assume that the flows are stationary Poisson s and 
tlat the system is a three phase queueing system Find its efficiency 
characteristics 

r, {rz ¥,)—the average number of customers in the queue in the 
first {second and third) service phase 

2, (2, Z3)—the average number of customers in the first (the second, 
the third) phase 

ty (tg tG }—the average queueing time of a customer in the first 
(the second the third} phase 

te (fe, fy )—the average waiting tume of a customer in the first 
(the second, the third) phase 

r—the overall average number of customers in all three queues 

z—the total average number of customers in the shop, 

tg—the total average queueing time of a customer 

‘yw—the total average wiuting time of a customer 

Answer tha fallawiung addationl quasvens (US Ta shack ghase and 
how should the servico be improved to reduce the waiting time of 4 
customer? (2) How can the fact that some customers having got 40 
invoice find they do net have enough money to pay (and so leave the 
system before the cashier queue) be taken into account? The fraction of 
such customers 1s @ (0< a <= 1) 
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Solution. Since all the processes are stationary Poisson’s, the depar- 
ture processes from all the three phases are also stationary Poisson’s, 
and three successive phases can be regarded as three individual queueing 
systems with their own characteristics. 

1. First phase. Since there are four assistants, the number of servers 


n= 4, Furthermore, ¢, = 14/u, = 5 min = 1/42 h, 9, = 45/12 = 
15/4 23.75 and x, = 9,/n, = 15/146< 1. From formulas (14.0.21)- 
(1.0.25) we find that 

3.75) 3.15)4 

(3.75) 4. (3.75) 


(3.75)? 
pe = {143.75 -$ 2-3 2:3°4 


.75)° “4 - I. 
tarts} © (151-58) = 0.0066, = 3.75, 


— (3.75)5 pp bas = 
rs; a 13.01, Zz, = 16.76, 


{Y= 7 0.289 hw 17.3 min, t) =< z,/r = 0.372 h we 22.3 min. 


2. Second phase. 4 == 45, 2, = 1 and p, = 0.75 < 1. From formulas 
(11.0.12)-(44.0.14) we find that 


re = p2/(1—p,) =9/4=2.25, 2,=p,/(1—p,) =3, 
i —7/u=0.05 h=3 min, t= 1/15 h=4 min. 


3, Third phase. Ibs = DB, r = 45, Os = 3/2 and Xe — Q.5 < 1. From 
formulas (14.0,.21)-(44.0.25) we find that 


p® ~ 0.210, rsa 0.237 and 2, 4% 1.737, 
{® 0.316 min and £@ ~ 2.316 min. 


Adding together the average numbers of customers in each queue, 
ve obtain the total average number of customers in the queues, i.e. 


rory trots & 15.5. 
: By analogy we find the average number of customers in the system 


21 Zo + Ze oe 24.5. 
average queueing time per customer 


ty = th 4-12 4 tf ~ 20.6 min. 








The average waiting time per customer 
toy == EY 4.724 ~ 28.6 min. 


| i) The Service can be improved by decreasing the waiting time of 
“he Smer in the first phase, which is the weakest phase in the system. 
faslest way to do this is to increase the number of assistants, 1.@. 
oo of servers in the first phase. For instance, a simple unit 
, 2° 1 the number of assistants (i.e. a transition from n, = 4to 
'= 9) yields an essential gain in time. Indeed, for nm, = 5 we obtain 
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for the first phase p, = 373, #, = 3 75/5 = O75, pl) = {59 71}x 
r, 208, 2, 2513, ty? wt 84 min and 4) ~ 6 84 min 
(2) We can take into account the fraction of customers & leaving t; 
shop without a purchase by multiplying the intensity of the arr 
process of the second and third phases by (1 — a) 
1125 Trams arrive at a railway shunting yard in an Erlang proc’: 
of order 10 with intensity ~A = 1 2 trains per hour*? The service tit’ 
of a train 7,,, 18 distributed over an interval fre? 
9 (E) 0 to 4 h with density gp (tj), shown in Fig f1: 
Using formulas (11 0 34) (11037), approvime - 
the efficiency characteristics of the yard, 1e 1” 
average number z of trains at the yard and in {~ 
queue r the average waiting time fy of a tri” 
and the average queueing time ¢, of a train, 
_ Solution For the distribution g (f) we he 
Fig 1125 ter = 1/3 and p—-Mp=O08<1 For a 16 
order Erlang process v? = (1/Pk)? = 01, vf c 


he found by dividing the variance Var(T,,,) by the square of +t 
mean value r= 1/2 = 05 


We find the characteristics of the queueing system : 
r= p? (oR + u2/l2 1 — ol] = 0 8 (01 4+ 0 5)/(2 0 2) = 096, 
z=r+o wO006 +08 = 1 7%, | 

t= rh wO8h, ty = ty ti/p wi id h 


11.26. Show that for an elementary nserver queueing system Ww 
an unlimited number of places in the queue the average number. 
customers in the queue is 


ahi tl " Tle 


ix x {n-type d "Tox: 





r 


‘i 


Solution We write the expression for r ia the following form { 
(11.023) and (#10 21)] ) 


— ane Po _ Ps _ p? 
r= ne nl (1—x}3 — (1—)? Pra where Pn==-y Pa 


Consequently 
p* Th Tl = 
+£+ +4+£-48 7+) 


i—¥*¥ 








*) Note that A here 1s the intensity of Erlang flow and not that of the | 
which was thinned out to get the Erlang flow 
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» the other hand 
j n nr % —i “4” (1—x)n 

n<(i+— 44+ +3 +45s) aca win d—t 
ite [y" (1 _— %) n\/[x” (7 —= 1) —- 1] < Prox “" (4 — %), the in- 
lity indicated in the problem is satisfied too. Note that the last 
ality can be used Lo approximate all the characteristics of the 
eing system In question. 
7, A railway booking-office has two windows in each of which 
ts are sold to two destinations, Leningrad and Kiev. The arrival 
esses of the passengers who want to buy tickets to Leningrad and 
‘have the same intensity A, = 0.45 pass/min. The average service 
‘per passenger (selling a ticket to him) f,., = 2 min. 
rationalization proposal has been made, i.e. that in order to de- 
the queues (in the interests of the passengers), the two booking- 
should specialize, one to sell tickets only to Leningrad and the 
tonly to Kiev. If we consider, as the first approximation, all 
arival processes to be stationary Poisson’s verify whether the 
sal is reasonable. 
lution. (1) Let us calculate the characteristics of the queue for 
‘oserver queueing system (the existing variant). The intensity of 
imival process 2 = 20, = 0.9 pass/min, uw = 1/t,., = 0.5 pass/min, 
“Mi=41.8 and x = 0/2 = 0.9< 1, thus limiting probabilities 
‘\ From formula (11.0.24) we have 


a —4 
po= {141.8422 —* 1 x 0.0525, 


‘fom formula (11.0.23) 


= _ 1.89.0.0525 7. | 
500 ~ 1.7 passengers, ty= 79 ~ 8.06 min. 
‘Inthe second (suggested) variant we have two single-server queue- 
i With p = Ap/u = 0.45/0.5 = 0.9 < 1. 
a “mula (44.0.13), the average length of the gueue at a window 
“PAL — 9) = 0.92/0.4 = 8.14 pass, and thus the total length of 
Wee at the two windows 2r = 16.2 pass. 


_leueing time of a passenger, according to (11.0.14), tg=rlhh = 


. — 
eee) 


Id the > min, and this is almost twice as long a queueing time 
Mnthisign ee variant, viz. 9.3 min. saa alae 4 
stitally - the rationalization” proposal must be rejec : eae 
Laffer diminishes the efficiency of the system. The reauc ne 
“etist} of the system caused by going from a oe oe 
‘eatee © Variant) to two single-server systems (the propose : pire 
“Tedts th division of the booking-office into two specialized 0 

© men at the windows to repeat each other. -_ 
mene elementary multi-server queueing system with “impatien 
ea: "Rd an unbounded queue. We have an elementary 


fey 
tig 
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nserver queueing system, the intensity of the arrival process 1s A, and 
the intensity of the service process is[ p= f/f,,, The queueing time 
of a customer is limited by a certain random time 7, which has an expo 
nential distribution with parameter v (every customer in the queue 
may} depart and the departure process has an intensity v} 

Write the formulas for the l:miting probabilities of states, find the 
relative capacity of the system for service Q, the average lenppth of the 
queue r, the average queueing time ¢, of a customer, the average num 
ber z of customers in the system and the average waiting time t,, per 


eusiomer 
Solution As before, we enumerate the states of the system in accor 


dance with the number of customers in the system The directed graph 
‘ A A oR 2 F, 
Se TY 5 ES [Eee ts, Beets, Cols, eee, se. 
ft P ft Jy Ape Fi jt ape an FP 


Fig 11 28 


of states 1s shown 1n Fig 411 28 Using the general birth and death 
formulas and introducing the designations p = A/p and 6 = vp, 
ne obtain 


_ pp, pp, p _ _ 
Po=1! + ap tgp + + nt A n-+f os (n-b B) (n+ 2p) 


pr -i 
+ tcp et 
p ‘ - 
A=W Po Pr= sr po (ikem), Panay Po 
Pars == aE Po 1 Pats 
a OL 
"nL (n+ B) + 28 (n-frpy 72 (r= 4), i288 


The first formula (41 28 1) includes an infinite sum, which is not 
4 geometric progression but whose terms decrease faster than the 
terms of a geometric progression We can prove that the error due te 
the tiuncation of the sum to the first r — 4 terms 1s smaller than 
pm {p/Byr e PfB 
nl rl 

We assume that we have calculated the probabilities py, Pris 

vote 1 Rep and we aow ahow chow ds iad dhe nihanar 

leristics of the queueing system the relative capacity for service Q, 
the average number of customers in the queve r and others We shall 
first find Q All the customers will be served except for those who will 
depart ahead of time Let us calculate the average number of customers 
who depart unseryed per unit time The intensity of the departure 
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process per customer In the queue is v and the total average intensity 
of the departure process per all the customers in the queue is vr. Hence 
the absolute capacity of the system for service 

ny eee (14.28.2) 
and the relative capacity for service 
Q= Al =1— vrlh (14.28.3) 


Thus, to find Q we must first of all know 7, which we could find di- 
rectly from the formula r = {Dn+y t+ 2Pnte + +s: + TPntr +o... 
But the drawback of this formula is that it contains an infinite number 
of terms. This can be avoided by using the expression for the average 


number of busy servers & in terms of A, i.e. k = A/p or, taking (11.28.2) 
Into account, 


From (11.28.4) we get 
T=(9— k)/B, (11.28.5} 
and the average number of busy servers i can be calculated as the mean 


value of the random variable K (the number of busy servers) with the 
possible values 0, 1, 2, .--, ” and the respective probabilities Do, 


Ps Por e+ ey Dnaas 14 — (Po + Pi + -°: =e eee) |: 
E= 4p, +2pp +0. + (0— 1) Pra tell — ot Ps 
Bes ss, 3 ee (41.28.6) 


_ Furthermore, we can calculate r by formula (11.28.5). The quantity 
t, can be found by Little’s formula: 


ty = T/n. (11.28.7) 
The average number of customers in the system 
g=r+ k, (14.28.8) 
and the average waiting time per customer 
i, = ain. (11.28.9) 


Remark. We can prove that for the queueing system with “impatient” customer 
We have considered, limiting probabilities always exist when 6 > 0. This is con- 
led by the fact that the series in the first formula (11.28.41) converges for any 
Positive p and B. This means, in essence, that a queue cannot increase indefinitely: 
es the queue, the higher the intensity of the departure process of the custo- 


itts29: An elementary two-server queueing system with “impa- 
ent” customers (see Problem 41.28). The intensity of the arrival 


— A = 3 cust/h, the average service time of one customer fe, = 
t=4h and the average time for which a customer waits for 
ase 


ee ~~ ~~ en 
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service “natrentlh,’ 13 05 h Calculate the limiting probabilities of 
states, restricting the calculations by the probabilities which are no 
smaller thin 0001 Find the characteristics of the efficiency of the 
system, :e @, «dl. #, ry tg, ty 

Solution. We hase A= 3, p= i, v= 2, p=3, P= 2, n=2 
From the formulas we derived for Problem 11 28 we get 


et a4 3 34 Kt 44 
me{it3s+5+ {t+ e+ tee t Feet 


a5 34 37 I}"'« 
+88 hoi 7 See wo i214 1 GOS 10 12 14 16 re 0 0692, 


whence 


Py = Sp, ~ 0 208 P,= 5 py 0 3, Py Pr we 0 234, 
3 


~ a 
Pye py 0 117, Pyp== py 0 04, Pe= ay Ps ee 0 O13, 


3 ij 
Prp= 75 Pe 0003 pp= 57 Py 0 001- 


The average number of busy servers ({1 286) & = ip, +2 (i — 
Po — P,) 1654 the average size of the queue from (11 285) r= 
(op — A)Ip = (8 — £ 654)/2 ~ 0673, the absolute capacity for service 
A =Ap 1 654 cust/h, the relatyve capacity for service @ = All, rm 
O551 and tg = r/k w0224 h, 2 =r +k ww 2 327 and ty, = 2/A 
O776 h 

11 30. An elementary queueing system with errors" Customers arrive 
at an m2 server system with an unbounded queue in a stationary Poisson 
process with intensity A the service time 18 exponential with parame 
ler p Being served 15 not a puarantee of satisfaction, and the server may 
satisfy the demands of a customer with probability p or not satisfy 
them with probability g=1—p In the latter case the customer 
returns to the system either heing served immediately, if there 15 no 
queue, or joining the queue Define the states of the system (numbering 
them in accordance with the number of customers present in the sys 
tem), ind the Limiting probabilities of states and the efficiency charac- 
teristics of the system and find the average number of reservice claims 
per unit time if every unsatisfied customer may claim for reseryice 
with probability 

Solution. The states of the queueing system are 

Sp—the system 1s dle, 

$;—one server is busy, ; 

5,—k servers are busy (1 <k <n},  «., {there 1s no queue 

S,-~all mw! Servers are busy, 

Sn+-—all m Servers are busy, r customers are in the queue (r = 1, 


2, 


The directed graph of states 1s shown in Fig 41 30, where = pl 
It can be seen from this graph that the system 1s equivalent to another 
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system with a complete guaraniee of satisfaction but with a service 
intensity of uw = pu; for this system ¢ = A/u = A/(pu). Formulas 
(14.0.24)-(41.0.25) remain valid only when op is substituted for p and 
uw for p. 


tot tp Fok 2s 
ya 2p k nye nt nie nh 


lemme a) 
Fig. 11.30 


11.31. An elementary single-server closed queueing system. One worker 
serves m machine-tools which fail from time to time (require reset- 
ting). The intensity of the failure process of one machine-tool is dX. 
If the worker is idle when a tool fails, he immediately begins to reset 
it. If he is not free, the tool joins the queue to be reset. The failure pro- 
cess of the machine-tool is stationary Poisson’s, the time needed for 


reset is exponential with parameter p = 1/t,,.. Define the states of 





mA (m-DA (m-k+t)a (m-k)a 2 
fE ft fe 
Fig. i1.3! 


the system, enumerating them in accordance with the number of faulty 
tools, find the limiting probabilities of states of the system and the 
efficiency characteristics: A, the average number of tools set up by the 
worker per unit time, w, the average number of faulty tools, r, the 


average number of tools in the queue, and Py,.y, the probability that 
the worker will be busy. 


Solution. The states of the system are 
Sys—all the machine-tools are in working order (the worker is idle); 
S;—one tool is faulty (the worker is setting it up); 
S5,—k tools are faulty, one is being set up, k — | are in the queue; 
Sm—allmtools are faulty, oneis being set up, m — 1 are in the queue, 
The directed graph of states is shown in Fig. 11.314. 
Designating p = A/u, we get the following from the general birth 
and death formulas: 
Po={i-+mp +m (In — 1) p2?+ ...+m(m—~1) 2... (m—k+1) 
+... + mip"y, 
Py=MPPo, Po=m(m—I1)p* po, ...; 
P,=m(m—{) ... (m—k-+ 1) p"p, (i<k<n),..., 
Pm = M!p™ po. (11.31.4) 


290 Applied Problems in Probability Theory 


In order to find the absolute capacity A, we first find the probability 
that the worker 1s busy 


Pousy = 1 — Pp (14 31 2) 
If the worker 1s busy he resets up j tools per umit time hence 
A = (1 — po) p (11 31 3) 


We can express the average number of faulty tools w interms of A as 
fallons Every operating machine tool generates a failure process with 


intensity A with m — w tools operating on the average The failure pro 
cess the machines generate has an intensity (m -~ w) and all the faults 


are eliminated by the worker This means that (1 — p,) u = (m — wyi 
whence 


w =m (1 — pip (41 31 4) 


The average number r of machine tools tn the queue can be found as 
follows 


wWaer-ph (14 31 5) 


where k 1s the average number of tools being served (or the average 
number of busy *ervers) In this case the number of busy Servers 18 zera 
af the worker 1s idje and umity if he is busy hencak = 0 p, +1 (i — 
Po) =1—p, Consequently 


r=m—(i—p)/p—(—pe) or F=m— (1 — py) (1 + 1/p) 
(11 31 6) 


_41132* On the hypothesis of Problem 11 31 find the average time 
ty for which an arbitrarily chosen machine tool that bas failed will 
have to wait to be served 

Solution Littles formula we have used 18 surtable only for open 
queueing system where the intensity of the arrival process does not 
depend on the state of the system It cannot be used for closed systems 
We can find the time ¢, by Just assuming that a demand arrives (a tool 
fails) at a moment ¢ We then find the probability that at that moment 
the system was in state s, (k = 0 m — 1) (it 1s clear that it 
could not be in a state s,,) Let us consider m hypotheses 

Hf,—the system was in state s, when the demand arrived 

H,—the system was in state s; when the demand arrived 

ff,—the system was in state s, when the demand arrived 

Am y—the system was in state s,, , when the demand arrived 

The a priori probabilities of these hypotheses are Pa, Pi 


Ph + DPm-1 

We shall now find the a posteriori probabrlities of the hypotheses 
given that the event A — {2 tool has failed in an elementary time 
interval (¢ ¢ + di}} has occurred On the hypotheses Hy A; : 
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Hm the conditional probabilities of this event are 
P (4 |H,.) = midi, P(A |A,) = (m—1)Adi,..., 
P(A | Ay) = (m—k)aAdt,..., P(A | Ama) =A adi. 


Using Bayes’s formulas, we find the a posteriori probabilities of the 
hypotheses (provided that the event A occurred). Designating these 


ed mp . (7m — 4) p 
Po ~“n-1 ; > Pi TAIT aa: 
S} (m—k) pr >} (m—k) Pr 
k=0 k=0 
as (m—k) pp sia __ Pm-~1 44.39.4 
PRS ay = 9 2*@ ee ¢ Pm-s — m—i4 se ( e Pi ) 
> (m—k) pp >; (m—kk) pp 
h=0 h=0 


If we know these probabilities, we can find the complete expectation 
of the queueing time of the faulty tool. If a tool fails when the system 
is in state sp, it will not wait for service; if the system is in state s,, 
the tool will remain in the system for the time 1/y on the average; if 
it is in state s,, then the time is 2/p and so on. Multiplying the proba- 
bilities (14.32.1) by these numbers and adding them up, we obtain 


m—1 
fg =— S\ Epp (11.32.2) 
k= 


11.33. A worker serves four machine-too!s (m = 4), each of which 
fails with intensity 4 = 0.5 faults/h. The average time needed for 


repair t,,, == 1/u = 0.8 h. All the processes are stationary Poisson’s. 
Using the formulas in Problems 11.31 and 11.32, find (4) the limiting 
probabilities of states; (2) the capacity A; (3) the average relative idle 


period of the worker P,,;.; (4) the average number of tools in the queue r; 
(5) the average number of faulty tools w; (6) the average queueing time 


of a faulty tool ¢,; (7) the average output of a group of tools, with due 
regard for their incomplete reliability, if a working tool produces ] 
articles. 


Solution. u = I/trep = 1.25 and p = A/u = 0.4. 

(1) From formulas (11.31.41) we have p, = {4 + 1.6 + 1.92 + 
1.53 + 0.61}-1 = 6.6671 0.150, p, = 1.6p, = 0.240, p, = 1.92p, = 
0.288, ps = 1.53p, 0.230 and p, = 0.06{p, ~ 0.092: 

(2) 4 = 0.850u ~ 1.06 tools per hour; 

(3) Praie = Po = 0.150; 


(4) r w4 — 0.850 (1 + 2.5) = 1.03: 


(5) w 1.038 + & x 1.03 + 0.85 = 1.88; a 


va 
re i 
~*~ 
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(6} from formulas ({1 32.1) and (i1 32 2) we have 


a 46 pint 
Po = ADyt3Py-+2Pg+ Pa G 283, 


Pi +0340, pe=0270, p;=0 108, 
ty=0 8 (py -+ 2p. + 3p3) 30 964 h. 


(7) the productivily of the group of teols is (m — w) 2 a 2 127 
1134 An elementary multi server closed queueing system A team of 
n workers handle m machine-tools (nm << m) The failure process of each 


tool has an intensity 4 and the average time for resetting a tool t... = 
1‘ All the processes are stationary Poisson’s Find the limiting prob- 
abtlitres of states of the queueing s}stem, the absolute capacity A 


and the average number of faulty tools w 

Solution Vee enumerate the states of the system in accordance with 
{he number of fiulty teols 

Syo—all the tools are int working order, the workers are idle, 

S,;—one tool 1s faulty one worker is busy, the other workers are 
idie, ; 

s,—A tools are faulty, 4 workers are busy and the other worl ers are 
idle (i. <— m), ‘ 

s,—n tools are faulty and all the workers are busy, 

Sy 4,—(n-+1) tools aro faulty, n of them are betng set up and ene tool 
is Waiting for service, : 

Saap~-(n +r) tools are faulty, » of them are being set up and r tools 
ave in the queue (nm r< im), , 

$;,—al] the m tools are faulty, nv of them are being set up and m — 
tools are in the queue 

We invite the reader to construct the directed praph of states of the 
system on his own and we only present the final formulas for the prob 
abilities of statcs 


m m (m— 4 — —k-+i 
mim—q} (m—n 
ns ec i 
4 4 mi{m—1) m—(n—+r—t) ner mio omyot 
ni nt pr + hin "J , 
ri (rm— f 
Pi Fy Pa py= A! pty, ’ 
—4 _ 
Pp = pipe (LR <n), 
-—-{ — | 
Pp = IE De, eas 
Dae = m (m-— 1} ener p™T p, i<r<m—1), 


P= — the p™py, where p= dp, (11 34 4} 
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The average number of busy workers can be expressed in terms of 
these probabilities, viz. 


k= 0-py + 1p, + 2p. 2 + (m% — 1) Po + Pn + Pn-+1 
tee t+ Dm) = Pi t2Pe +... + (n—1)+) Par 
a ae | (11.34.2) 


The absolute capacity for service 
A = ku, (11.54.3) 
and the average number of faulty tools 
w= m — kul = m — kilo. (11.34.4) 


11.35. Two workers (nm = 2) are handling six machine-tools (m = 6). 
A tool must be reset every half-hour on the average. Ten minutes, on 
the average, are needed for a worker to reset a tool. All the processes 
are stationary Poisson’s. (1) Find the characteristics of the queueing 
system, i.e. the average number of busy workers k, the absolute capacity 
for service A and the average number of faulty tools w. (2) Find out 
whether the characteristics of the system will be improved if the workers 
Were to reset the tools together, spending five minutes on the average 
lo reset a tool when working together. 

Solution. (1) We solve the problem in the first variant (the workers 
work separately). We have m = 6,n = 2,4 = 2,p = Gando = A/p = 
1/3. By formulas (11.34.1) we have 


6 4 6-5 4 6-5-4 41 6-5-4-3 4 
Po= {! +r 73° 4-2 ar 1-222 350 4-2-22 38 


6-5-4-3-2 4 6-5-4-3-2-4 4 7-1!  aae 
hea CS eek Le Lae oz 0.153, 
Py = 6/1 xX 1/8p, ~ 0.306. 


We use formula (11.34.2) to find the average number of busy work- 
Ts, lew k= 4p, +2 — po — p,) 1.235. The absolute capacity 
er kw 7.41. The average number of faulty tools w = 6 — 7.41/2 ~ 


(2) If the workers work together to reset the tools, then the queueing 
a turns into a one-channel system (m = 6, x = 1) for p = 42. 
Ve do the calculations for o = A/u = 1/6. By formulas (11.31.1) we 


vet 
= 6-5 , 65-4 , 6-55-43 , 6-5-4-3-2 , 6-5-4-3-2-4 )-1 
mea (Let p GS  SE 4 SEES | OF EBE | BEES EE) 
~ 0.264, p, + 0.264, p. 0.220, ps 0.147, p, 0.076, 


Ds ~ 0.024, Poe 0.004. a 0.736 


(76 my 1.59. 
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The average number of busy channels k=1—p,) = 0736 Bearing 
in mind however, that in this case the “channel” consists of two work 
ers, the average number of busy workers 1s 


R= 2x0736 wi 47 and A = kp = 0786x1288 


Thus, in this case, by assisting each other, the workers (channels) 
increase the average busy period from 1 23 to 1 47, reduce the average 
number of fault, tools from 2 30 to 1 59, and increase the capacity 
from 74 to 88 

11 36 Jobs arrive at an clementary three channel congestion system 
In a process with intensity 4 = 4 jobs/min, the service time per job 


per channel #,,, = t/u = 05 min Is it better, from the point of view 
of the capacity of the system, to make all three channels serve each 
job together so as to decrease the service time of a yob to a third? How 
will this afiect the average waiting time of a job? 

Solution (1) We find the probabilities of states of the system with 
out any interchannel assistance, using Erlang s formulas (11 0 6}, 1¢ 


ps 2 234-1 23 
p={ira+s-+a} ax 0 158, Prep = Pg a, Po 0 21, 


O=1—Piy e079, A= wI16 
We then calculate the average waiting time ofa job as the probabrlity 
@ that a job will be served multiphed by the average service time, re 
t, ©0079 05 +0395 min 
(2) If we combine the three channels into one with parameter = 
3% 2=6 we obtain 


i 
Po= Waar =P 6, p,=(2/3)06—0 4, 


Phe =p, =04, O=-1—P,,=06, A=IAQ=4x06=24 


Comparing the capacity of this system to that of the first variant, 
we see that 1t has not risen (as was the case in the preceding problem), 
indeed 1t has fallen! It is easy to understand why this happened When 
the two channels were combined, the probabrlity of refusal rncreased 
(the probability that an arriving job finds both channels busy and 
departs unserved) 

The average waiting trme of a job 1s smaller in the second variant 


than in the first @, = Q (1/6)—04 min However, this decrease has 
a high cost since it comes at the expense of a number of Jobs departing 
unserved and, hence, their waiting time 18 zero 

Why then in the preceding problem did combining two channels 
into one increase the efficiency of service? We invite the reader to 
think this over and explain the seeming contradiction Is it because 
In a System wath refusals yobs do not join the queue? 

1{ 37. We are gtien an elementary three-channel system with an 
unbounded queue The intensity of the arrival process 15 1 4 de 


mands/h and the average service time tz, = i/p = 09 b 
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Bearing in mind (1) the average length of the queue, (2) the average 
queueing time of a demand and (3) the average waiting time of a de- 
mand, is it advantageous to combine all three channels into one with 
an average service time three times as small? 

Solution. (4) In the original variant (three-channel system) n = 3, 
A= 4, p= 1/05 = 2, p=A/u=2 and x = p/n = 2/3< 1. The 
limiting probabilities exist. We calculate py by formulas (411.0.24): 


2 92 93 24-(4/3) yt 4 
Po= }1 + apart pt aria —=9? 


—, 


see et |e ee Fr Se 
== Sahin 9 ~ 0.889, tg = ~ 9 ow 0.222 h, 
te 


= tg + trer 0.722. 


(2) When we combine the three channels n=1, 1 = 4, p = 6, 
and p = 2/3. From formulas (41.0.42)-(11.0.14) we have 


— (2/3)? rye 
r= 173 1.333, tg= 7 


fy = Eq + tgey = 1/3 + 1/6 = 0.500. 


We see that although combining three channels into one slightly 
reduces the average waiting time of a demand (from 0.722 to 0.500), 
it increases the average length of the queue and the average queueing 
time of a demand. This is because the arriving demands must wait 
in the queue while the three channels serve a demand together. 

The increase in the service efficiency when channels are combined 
in a closed queueing system is due to the fact that the intensity of the 
hae process of demands decreases when their sources (machine-tools) 
ail. 

11.38. We consider a queueing system which is a taxi-rank at which 
passengers arrive in a stationary Poisson process with intensity A 
and cars arrive in a stationary Poisson process with intensity pp. The 
passengers form a queue which decreases by unity when a car arrives 
at the rank (we take a case when the taxi-driver drives the passenger 
Wherever the latter wants to). If there are no passengers at the rank, 
the cars form a queue. The number of parking places at the rank is 
limited (is equal to m) and the number of places in the queue for pas- 
stngers is also limited (equal to 2). All the processes are stationary 
Poisson's. A passenger boards a taxi instantaneously. Construct the 
directed graph of states of the system, find the limiting probabilities 


of states, the average length r, of the queue of passengers, the average 
length ry of the queue of cars, the average queueing time per passenger 


(a-n» the average queueing time per car ty, and see how these charac- 
teristics will change as m —> co and 1 -+ oo. 

Solution. We shall enumerate the states of the system in accordance 
With the numbers of passengers and cars at the taxi-rank, labelling oe 


~ 0.333 h, 
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ther by two indices the first index for the number of passengers and 
the second for the number of cirs The state s,, means that there are 
neither passengers nor cirs at the rank, the state s,, means no cars and 
k passengers, the state s,, means ¢ cars and no passengers The directec 
eraph of states of the system 1s shown in Fig 11 38 The graph corres 
ponds to the birth and death process Employing the general formula: 
(11 0 4) for this process and designating A/p = p we obtain 


Prey o — PProar Peo = p*p, ar = «¢ Pog = p'*p, Gr = #04 
Pog = e'p, Or + Por = pithy, opty Pom = po’ p, OF 


Poo = {lt ptr... # pet (11 384 
or summing the geometric progression with @ common ratio p, 
Pio = (1 — pV — pt) (11 38 2 


The probibalities in (11 38 1) form a geometric progression with the 
first term p,q and a common ratio p If p 1, then the most probabli 


A a A 





Fig i138 


state of the system 1s s,,, which means that there are no cis and al 
the places in the queue of passengers are occupied, if p << 1, then th 
most probable state 15 s;5, which means that there are no passenger 
and all the places tn the queue of cars are occupied 

AS m~—» oo and 1 + oo no limiting probabilities evist, for p > | 
the queue of passengers and for p < 1 the queue of cars tend to increase 
indefinitel, (but this tendency 1s restricted by the fact that neathe 
the number of passengers nor the number of taxes 1n the city 1s infinite) 

11 39* In a selfservice canteen there 1s one distribution counte: 
at which both the first and the second courses are served Customer: 
arrive at the canteen in a stationary Poisson process with intensity A 
the service of the first as well as the second course takes a random tims 
which has an exponential distribution with the same parameter | 
mome customers take the first and the second course (the fraction 0 
such customers is g} while the others take only the second course (the 
fraction of them is 1 — g) Find (1) the conditions under which there 
is astable, stationary state of service at the canteen, (2) the average lengtt 
of the queue and the average watting time of a customer rf he needs 
% ‘tit “Lun ‘lite WEE ‘to eat One course and a ‘time &t ‘to exh We 
courses 

Solution The service time of one customer is a random variabli 
# which has either an Erlang distmbution of order 2 with the meal 


value ty, = 2/p with probability g or an exponential drstributioy 
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with parameter ,. with probability 1 — g. Let us find the mean value 

of the random variable 7. To do that, we use the complete expectation 

formula (4.0.20) with two hypotheses: H, = {a customer takes only 

the second course} and H, = {a customer takes both courses}. The 

probabilities of these hypotheses are P (H,) = 1 — gq and P (#7,) = gq. 
The complete expectation of the random variable 7 


MIT] = P (4,) MIT | #,) + P (4,) MIT | Z,] = (4 — g) (A/n) 
+g (2/p) = (¢ + 1)/p. 


This means that the canteen can serve pu/(q + 1) customers per unit 
time on the average. If A > u/(q + 1), then the system is overloaded 
and limiting probabilities do not exist, but if A< p/(¢ +1), then 
they exist. We assume A < p/(q -+ 1). 


To find the average size of the queue r, the average queueing te and 


waiting ¢,, times of a customer, we use the Pollaczek-Khinchine for- 
mula (11.0.31). To use this formula, we must know the coefficient of 
variation of the random variable 7’, i.e. the service time. We first 
find the second moment about the origin of that variable M [T?]. From 
the complete expectation formula (with the same hypotheses H, and 
Hy) we obtain 


MIT?] = (4 —q) MIT? | Ay] + (MIT? | HH). (14.39.14) 


On the hypothesis H, the random variable 7 has an exponential 
distribution with parameter ,1: 


M{7? | A,) = Var[7T | 4,) + (MIT | H,))? = t/p? + (1/p)? = 2/p?. 


On the hypothesis H, we calculate the second moment about the 
origin of the variable 7 by the formula 


M{7? | H.] = Var {[T | Hol + (MIT | A,})°. 


But MET | Hy) = 2/u, (MIT | H2])? = 4/p?; the variance Var [T | H] 
is twice as large as Var [T | H,] since it is the variance of the sum of two 
independent random variables 7, and 7, which each have the same 
distribution, i.e. Var {7 | H,] = 2/u*. Consequently 


M[T? | H.] = 2/u? + 4/n? = 6/p*, 
Whence we get by formula (11.39.1) 
M [77] = (4 — g) 2/p? + g6/u? = 2 (1 + 2¢)/p?. 
The variance of the random variable T 
Var {7} = MI7*] — MIT]* = 4 + 2¢q — q*)/p*. 


sty this we can find the coefficient of variation of the random vari- 
apie 7’, i.e, 


Vy = V 14+ 29¢—@2/(q+1). 
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Substituting this expression and the expression p = A (q¢ + 1Vin 
into the Pollaczek Khinchine formula {11 0 31}, we get 


1-+-2q¢—9? 
(Myy*) (q~p 1)? [+e | Op) (Ht - 29 
a Taree TCTs |) ee EST eT 


Furthermore, tg = r/A and tw = ty + (g + 1)/e +g + 4) = t, + 
q +41) (t+ 1A) 

1140 Anezample of anelementary congestion system with priority 
Customers arrive at a two server congestion syslem in two stationary 
Poisson processes process J with in 
tensity A, and process I[ with in 
tensity A, {for brevity we shall call 
them “customers I’ and ‘customers 
Il) Customers | have a priority 
of service over customers IT such that 
if a customer J arrives when the ser 
vers are busy and at least one of them 
18 serving customer [] then the arriv- 
ime customer J displaces customer 
I] occupies his place and the latter 
departs unserved If a customer I 
arrives when the servers are alf serv- 

Pig 12 40 ing customers [, he 1s refused and 

leaves the system Customer [I] 15 

refused if he arrives when both servers are busy (no matter which 
customers are being served) 

Construct a marked directed graph of states of the queueing system 
labelling the states by the indices (i, ;} the first index showing the num 
ber of customers I and the second, the number of customers IT present 
in the system Write the equations for the limiting probabilities of the 
States Solve them at A, = A, = n, =u, = 1 Express the following 
efficiency characteristics of the system in terms of pyy (¢ +7 < 2) 

Pret (Pytg)—the probability that customer [ ({{I} will be refused 
when he arrives, 

A, (A,}—the average number of customers I (fI} served by the queue- 
ing system per umlt time 


fit 2) the average number of servers busy with serving customers 





Peer A, A—the same characteristics for the system as a whole, 
irrespective of the type of customer 

solution The states of the System are Sgo, there are no customers 
in the system 1), there 1s one customer I and no customers II in the 
Sysiem s,, there are no customers { tn the system and one customer If 
Sao, there are two customers J in the system and no customers II 
S$, there 1s one customer each I and Il, sp. there ate no customers 
and two customers II in the system The marked graph of states of the 
system 18 shown in Fig 11 40 
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The equations for the limiting probabilities of states: 


(Ay + Ae) Poo = PiPio + BePorr (Ar + Ag + Bi) Pro = ArPoo + 24 
X Poo + BePir> 2byPoo = AqPio + AgPury (Ay + Ag + fe) 
X Por = AePoo + MaPis + 2bePoo. (Ar + By + He) Pir = AsPro 
+ AyPor + AgPoes (Ax + 22) Poo = AsPors Poo + Pro + Poo + Por 
+ Pu t+ Poe = 1. 
Solving them at A, = Ag = Uy = MWe = 1, we get 
Poo = 0.20, Dyo = 0.25, Puy = 0.20, poy = 0.15, 
Pry = 0.15, Pog = 0.05, Pret = Poo = 0.2Pret 
= Poo + Pur + Pos = 0.40, Ai = A, (1 — Prt) = 0.8. 


We calculate the variable A, taking into account that some custom- 
ers II that have started to be served are displaced by customers I 
and depart unserved. The average number of such customers per unit. 
time is Ay (Pi, + Poo) and, consequently, 


A, = hell — (Peo + Pry + Poo)) — Ay (Pir + Pos) = 0.4, 
ky = Ayu, hy = Aol pe. 


The probability P,,, that an arbitrarily chosen customer arriving 
at the system will be refused can be found by the total probability for- 
mula with hypotheses H, = {a customer I has arrived} and H, = 
{a customer IJ has arrived}. The probabilities of these hypotheses are 


P (H,) = A,/(A, +A.) and P (H,.) = A,/(A, + 4d,). 
Consequently 


___ 1 pm Ae pe, 
Pret a “Ma to Pret “ie Ps Pret = 0.3. 


Note that we could obtain all the characteristics for customers I by 
completely ignoring customers IT and treating the problem as if only 
Customers I arrived at a two-server system with refusals. We invite 
the reader to verify this by calculating all the characteristics for a two- 
server system with refusals at which only customers I arrive. 

11.41. The conditions of the preceding problem are changed so that 
the number of servers in the system is nm = 3. Construct the directed 
graph of states of the system. Write the equations for the limiting 
probabilities p;,; (i + 7 <3), where i is the number of customers I 
and 7 is the number of customers II which are present in the system. Con- 
Sidering the equations to have been solved, express the same efficiency 
characteristics as enumerated in the preceding problem in terms of p;;. 

Solution. The directed graph of states is shown in Fig. 11.41. 
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The equations for the limiting probabilities of states are 
(Ay + As) Pos = MyPyq + HaPor, (Ay + Ae + 11) Pio 
= AyPoo tb 2p Bag 1+ Hefiys {Ay tb Ag + 2tty) Pao 
= AiPio + Spy Pso + HePoi, 
(Ay b Ay + tts) Bo, = Agog + Matty, “Fh 2tteDoss 
Ar be POM Ba) Por = Aye Lb Agere t PR Pay “beets 
(Ay tt Pe + Spy) Par = Ay (Pay + Pie) + AaPagy (Aq + Ag + ts) Pos 
=F oPort PiPiet ShePos, (yet Hy + 2s) Pye = Ay (Pog + Pos) + AePus 
(Ay + Sig) Pos = AgPoa, 
Poo 7 Pio + Pao 7 Bag + Poy + Pir + Bor + Por + Pie + Pos = 1, 
Pret = Pa Pr = Pso + Por + Pia +b Pos 
Ay = Ar dh Pao} Ag = Ag EL — Gry + Pn + Pra b Poall 
— Ay os + Pis + Pos), 
hy =Adlty, He =Aghpy, B= Hy thy 
A 
Pret = par Pil} ata Pat 
1] 42 An ezample of a queueing system with absolute priority Custom 
ers | and I] arrive at q single seryer quevetng system with two places 
in the queua (m = 2} in two 
stationary Poisson processes 
with intensities A, and A, 
The service times are expo 
nential with parameters py and 
be A customer I who arrives 
at thesystem displaces custom 
er Il 1f he is being served or 
takes a place im the queue in 
front of him if he is in the 
queue The displaced customer 
II leaves the system unserved 
if there are no more places im 
the queue or joins the queue 
f there are places Labelling 
the states of the system with 
the indices : and } corre 
sponding to the number of 
Fig 11 41 customers J and I] present in 
a the system, construct a marked 
rected graph of states of the system and write the equations for 
the limiting probabilities of states Considering these equations to have 
been solved, express the following efficiency characteristics of the 
System in terms of pry (2 + 7 <3) 





f 
i 


' 
§ 


i 
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po (Pi2+)—the probability that a customer I (II) will be refused 
immediately after his arrival; . 
0, (Q.)—the probability that a customer I (11) will be served; 


z, (z,.)—the average num- 
ber of customers [I (II) in 
the queueing system; 

r, (rz)—the average number 
of customers [I (II) in the 
queue; 

iP (t)—the average wait- 
ing time of customer I (II); 

(1) (42) —the average queue- 
ing time of customer [| (I]); 

t,—the average waiting 
time of any (arbitrary) custo- 
mer; 

t,-—the average queueing 
time of any customer. 

Solution. The states of the 
queueing system are s;;, 1 
customers I andj customers {I Fig. 11.42 
are in the system (i + j< 3). 

The marked directed graph of states is shown in Fig. 11.42. 

The equations for the limiting probabilities of states are 





(Aq + Ag) Poo My Pio + iePorr (Ag+ Aa Bt) Piso = As Poo 

+ PyPoot BePitrs (Ag-b Ag+ Bi) Poo = M4 Ps0 1 Va P30 1 PePats 

HyPgq = Ay (Poo Pos), (Ag Ag Be) Dot = A2Po0 + Mi Pi + PePo2 
(hy Ag BaF Be) Pas = AoPio + AaPos + Ma Pot + BePres 

(Ay Ag+ He) Poo = AePos + Pi Pi2 + HePos: 

(Art By + oe) Po = ApPon tb AaPtrt MaPos (At Be) Pos = AzPoe: 

Poot Prot Peo + P30 Por + Pir Par + Port Prat Pos = 1; 
Pret = Pso, Pret = Psot+ Por t+ Pi2+ Poss Q1= 1—Prer=1— Dao- 


To find Q., we first seek A, which is the average number of custo 
mers II served per unit time, i.e. 


Ag = he (1 — Pret) — a4 (Pos + Pie + Pas) 
he {1 — (Pao + Par + Pas + Pos)] — % (Pos + Piz + Por). 


Dividing this expression by 4., we find the average fraction of custom- 
ers Il being served (the probability that a customer IT will be served). 


26—0575 


{ 
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ie Q@,=A,/4, Then 
‘2y = 1 (Pig + Pa + Pas) + 2 (Poo + Par) + 3Pao. Zs = 1 (po + Pas 
+ Poy) +2 (Poy + Pre) + 3p 03 ; = 1 {Pyy + Par) + 2P 59 
re =f (Py + Pal + 2p, 
By Little s formulas 
Lpmalh, IP=2ldA, tory tP—4r/), 


7 we : An 52 OP _ Ar on _ As 72 
we EG PRR a Taye bay 





Vee can calculate all the characteristics relating to customers | 
without solving equations (11 42) but saumply by ignoring the presence 
of customers I] and considering the system to be one with a limited 
number of places in the queue (m 2) ind using the formulas in 
Sec ff 0 (ttem 4} to find sts characteristics 

1143 An elementary system without a queue and with a eating up’ 
of the channels Demands arrive at the input of an n-channel queueing 
system in % stationary Porson process with intensity A The sersice 
time 15 exponentini with parameter y= Before the sersice is begun the 
channe} must be prepared ( heated up } The time needed to heat’ 
the channel 7,,, has 1n exponential distribution with parameter v 
and does not depend on how long before the channel ceased functioning 
A demand which arrives when a channel 15 1dle eccupies it and waits 
for it to be heated up and then its service commences A demand which 
arrives when ail the channels are busy (when another demand 1s being 
served or is wtilirg to be served} departs unserved Find the lumiting 
probabilities of the system and the efficiency characteristics 1¢ the 
probability of refusal P..y the relative capacity for service Q the 


absolute cipicity A and the average number of busy channels & 
Solution We assume that the job servicing procedure consists of 
two phases waiting for a channel] to he heated and the servierng itself 
faee ~ Lneat -+ Tye, The random variable 7... has a generalized 
Erlang distribution of order 2 {see Problem 8 39) with parameters 
and v We hnow that Erlang s formulas (11 0 6) are valid not only for 
exponential hut also for any distribution of service trme Let us find 


the variable u — 1/M [Poe] We have 

MET se] = MEP peat] + MU Tye) — A/a + d/v = (hp + vy (tev) 
whence » = (uv)/(u + v) Having calculated p = A/u and substatuting 
this value of p into Erlang 8 formulas {110 6) we obtain 


le 


Po= {it +24. +4 +} 


i Ha 
» Pr= v. Po (isk<n), 


m, ms ~, 
Pret = n> Pp Q=1—-5. py A=1Q=1{1 —£- po) 


Ch. 11. The Queueing Theory 403 


To find the average number of busy channels k, we must divide 
A by w: 


bak (1-2) po=6(1— $7) Po 


11.44. An elementary one-channel queueing system with a “heated” 
channel. Demands arrive at a one-channel queueing system with an 
unbounded queue in a stationary Poisson process with intensity 2d. 
The service time is exponential with parameter wu (jt > A). Before the 





Fig. 11.44 


demand is serviced, the idle channel must be heated. The time needed 
to heat the channel is exponential with parameter v and does not de- 
pend on how long before the channel ceased functioning. If the service 
hegins immediately after the service of the previous demand has ended, 
ho reheating is necessary. Construct the directed graph of states of the 
queueing system and write the equations for the limiting probabilities 
of states. Express the efficiency characteristics of the system in terms 
of these probabilities: the average numbers of demands in the systemz 
and in _the queue r and the average waiting and queueing times 
of a job t,, and Z, respectively. 
Solution. The states of the queueing system are (Fig. 11.44): 
Sop —the channel is idle but not hot: 
Sy;—a job has arrived and is waiting for the channel to be heated; 
5j;—the channel is hot, one demand is being served, there is no queue: 
a channel is being heated, there are two demands in the 
Oy wt 
So:—the channel is being heated up, there are 1 demands in the queue; 
— channel is serving demands, 7 — 4 demands are in the 
le, .. 


The equations for the limiting probabilities are 


Poo = EP, (A+ V) Por = APoon (A+ BL) Py = VP or “F EPies 
(A + ¥) Dos = APow (A + B) Pig = VPoo + APy + Pigs ee 
(A + V) Por = APot-a> 
(A + i) Pi = VP ot 7 APy toa TE OMPyrtis eo 

0 


z= 2 l(Do,1+ Pay t)s r= 2s L(Do,1 + Ps, 141) 


i={ 


{Ge 
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By Lattle’s formula . 
te = tlh, tg = rid 

11 45* We are given a single server system with a limited number 
of places in the queue m= 2 Customers arrive at if in a stationary 
Poisson process with intensity A 

The service time has a generalized Erlang distribution with para 
Ineters pt, and pt, (see Problem 8 39) Find the probabilities of the states 
of the system 

Sg~-there are no customers in the system, 

s,—there ts one customer in the system (no queue), 

s,—there are two customers in the system (one 1s being served and 
the other 1s waiting to be served), 

$y—there are three customers im the system (one is being served and 
two ate in the queue} 


(4) Find the efficiency charactemstics of the system P..., 0, A 2 


tty t, (1) Calculate them for the values 4 = 2, py = 6 and pw, = 12 
(2) Compare them with the characteristics which would result for an 


elementary queueing system with the same A and p equal to t/t. 


where ¢,,, 15 the average service time of a customer in this system 
Solution (1) The service process 1s not Porsson’s and, therefore, the 
system 1s not Markovian This means that to find the probabilities of 
States of the system, we cannot use the 
ordinary techniques we used for Markov 
processes with discrete states and con 
tinuous time However, we can artii 
cially reduce the process taking place 
in the system to a Markov process by 
applying the so called methad of phases 
We assume that the service 1s 19 ino 
phases (I and JI) which last for the times 
7, and 7’, respectively The total service 
time 7... = 7, +72, where 7, has an 
exponential distribution with parameter 
1, and J, has an exponential distribu 
tion with parameter p, Then 7, will 
have a generalized Erlang distribution 
with parameters u, and u, (see Problem 
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We introduce the following states of the system 
$y—the system 13 idle 
S,,—there 1s one customer in the system, the service 1s 1n the first phase 
Sia there is one customer 1n the system, the service 1s in the secon 
phase 
$2;—there are two customers in the system (one 1s being served and the 
other 1s waiting to be served) the service 1s 1n the first phase, 
122 there are twa customers in the system, the service 1s 1m the second 
phase 
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s3,—there are three customers in the system, the service is in the first 


phase; Oo 
S,.—there are three customers in the system, the service is in the 


second phase. 

There are no other states since (m = 2 by the hypothesis) there can 
be no more than three customers in the system. The marked directed 
graph of states of the system is shown in Fig. 11.45. Using this approach, 
we divide the state s, into two states: s,, and s,. (or, in a brief form, 
$) = Sy, + 8,2). Similarly sy = Sy; +S and sg = S3,-+5g,. The equa- 
tions for the limiting probabilities which correspond to the graph in 
Fig, 141.45 are 


hMPo == MoPre. (A + By) Pir = ADo + MePoo, (A + He) Pre = buPu> 
() +- Yi) Por = PePse + APus (A + bs) Por = bier + AP, 
P31 = Apor, Wellgo = byPay + APoos 


with the normalizing condition py + Piz + Pig + Por + Poo + Par + 


32 ° 
Solving these equations, we obtain 
A-+ps)A , A AS (AE fly Ho) + AP pe (AE He) 
—J4 ( [He Sa 1 2 2 2 
#0 { 7 te Be pips 
a A? (A+ py + Bo) a2 M4 (A pty 4- He) + AB te (Ab pe) 
by Be pany 
ue AS (A+ py -+ Be) aa M4 (AE py + Ba) Ape (A+ pe) \" 
Jy LS PP Ls 
_ (A+Be) & _ A AS (A r+ Be) ABH (A+ pe) 
Pit hyn, Po Pi2 =~ Por  eecemeaa * panemmmaea 
i A2 (ty + Uo A) 
bly 3 


Po: 


P22 Po: 


M4 (A 3 
Dey = he Pos 
M2 


_ fA‘ (AP py tb Ha) ASpe (A + fg) AS (A pa He) i 
P30 | ene + Se | Po- (11.45.1) 


Next we find the limiting probabilities of the states Sis S55; Oa: 





rn 
Pt Put Pe = Tyits (A+ py + py) Do, 
; AZ 
Po == Poy Pao ene (A+ Ly) (A+ Ly + [ty) tbe (A+ Lo)] Poa; 
13 
Ps= Pat Pg. = Tee [(Apts + Apy + pt) (A+ [Ly + po) 


“TF He (by + Be) (A Be) Pos (11.45.2) 
Where py is defined by the first formula (14.45.14). 
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The efficrency characterstics of the system can be found 1n terms of 
the probabilities Po, Pir P2 Ps by the formulas 


Pret Pas ? =-1- Par A=k (I — Ds), 
= ip, + 2p, + 3p,, r= ip, + 2ps, 
i, = lA, ty = rid (11.45 3) 


Substituting the numerical data 4 = 2, p, = 6, pb, = 12 into for 
mulas (114541), we obtain p, = 0540, py, = 0182, py = 0090, 
Po = 9087 po, = 0050, ps, = 0029 and ps, = 0022 We now 
return to the initial (not Markovian} queuetng system and obtatn 
pop = 0540 p, = 0272 p, = 01387 and ps = 005! 

Furthermore we have from formulas ({1 45 3} P,., = 0051, 0= 
099 4-189 2=0705 r = 0243, t, = 0352 and t, = 0122 

(2} We calculate the same characteristics for an elementary queueing 
system with the same A = 2 and p = (f/m, + d/pg)* = 4 From for- 
mulas (41.012) (41015) wehave p= 05 py #0533,A = 1—py 
O467 p, = pp, ~ 0267 p, = p*p, w~ 0133, ps = p?py we 0 06), 
Pep = Ps 0007 O=1 — p, +0933, A wil 866, 2 & 0 733, r= 
0267 &, 20367 and % +0133 

We see that our nonmarkovian queueing system has some advantages 
over an elementary queueing system as concerns the capacity for servtce 
and differs but little from at (to the better) as concerns the wanting time 
of a customer and the size of the queue. 

11 46* There is a single server queuemg system with two places 
in the queue Customers arrive at 1t in a Palm process, with an inter 
arrival time 7, which has a generalized Erlang distribution with param 
eters 4, and Ag the service time is exponential with parameter p 
(1) Applying the method of phases, write the equations for the lmmiting 
probabilities of states py, py Po, pg Lxpress the following charac- 
teristics of the system in terms of these probabilities Prep, @; Ay 7: 
r ft, ft, (2) Calculate the limiting probabilities and the efficiency char 
acteristics for the following initial data A, = 3, 4, = 6 and p= 4 
and compare them with the characteristics for an elementary system 
with parameters A = (1/A, + 4/A,)7? = 2 and p = 4, the one con 
sidered in Problem 11 45 

Solution (1) If we consider (as usual) the states of the system num 
bered 1n accordance with the number of customers in the system, Sp 
$, Sg S, then the system will not be Markovian To make it Marko 
yran we shall divide the interarrival tume 7, rather than the service 
time into two phases (I and HW} 7 = 7,+-7,, where the random var 
ables 7, and 7’, have an exponential distribution with parameters A, 
and A, respectively 

We shall enumerate the states of the system in accordance with the 
number of customers present in the system and the number of phases 
between the customers 
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Sy, —there are no customers in the system, the interarrival time is 
in the first phase; 

Syo—there are no customers in the system, the interarrival time is 
in the second phase; 

$,,—there is one customer in the system (being served), the inter- 
arrival time is in the first phase; 

S,o—there is one customer in the system 
{being served), the interarrival time is in the 
second phase; 

S,,—there are two customers in the system 
{one is being served and the other is waiting 
for service), the interarrival time is in the first 
phase; 

Sso—there are two customers in the system 
{one is being served and the other is waiting 
for service), the interarrival time is in the second 
phase: 

S5,—there are three customers in the system 
{one is being served and two are in the queue), 
the interarrival time is in the first phase; 

Sso>—there are three customers in the system ; 
{one is being served and two are in the queue), Fig. 11.46 
the interarrival time is in the second phase. 

The directed graph of states of the system is shown in Fig. 11.46. 

The equations for the limiting probabilities are 





Por = WPiyy AePoo = AyPor + BPiey (Ay + B) Pry = AsPoo + Pay: 
(Ap + 8) Pro = AyPyr + Pan. (Ay + BL) Pay = Ae Dyg + MP sis 
(Ae + LL) Poo = AyPor + BP32. (Ay + 1) Pay == AgPeo + AcPaey 

(Ao + B) Dae = AyPai. 


The normalizing condition is po, + Por + Pry + Pie + Por + Poo + 
Ps, + Pgo = 1. 


It is most convenient to solve these equations by expressing the 
Probabilities p;,; in terms of the last probability, p,,. The expressions 
for the probabilities Piy (6 = 0, 1, 2, 3; 7 = 1, 2) have the form 

, plete, (u+A, LAS u (ue A Jhott +22 
Pay={t-+ et 4 WM at Mi tie Ae as aft Az) 
| wypivo wypfe 
gu? (p12 1 QA pt 2hopt + AZ Ay Ag 4 AZ) 
hehe 
pu? (13 + 204? 322i AP +t QA, Aopt-b BA 2n + 23) 
i 332 = 7 
MSA 
= ge (408 1 3A, 07 + SA? + BAT 4A y holt SAS HP AY -f- hihe bby AI 19} 
i A tr A rE 
TY: 
FE WS +20, uF 4 8A uP Ap Ay Patt + 323+ 2.3) ) -1 


t 
i 
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P30 





h rea 
Ps PE pp Py ee 


i 
_ fedpt Arne Zhao Ag} 
Pat hike P3 


gg = EEA hah Bhan ME Mada t AD 
" MEAG 32 
BY uP 24 WH Shap? + Mp P20 Robt Shep ha) 
uu AAR Pa. 
pe? (pS Say Het Shgut te Atif 4d op 


EARL AG+ AIAG + 4422-423) 
Poo = AeA2 Ps 


pS (uP 2A i274 Shape AB t+ ZA Ag + SAR + AR) 
Pou nah P32 

Returning to the initial (nonmarkovian) queueing system ‘we ob- 
tain = Pg = Por + Poo Pi = Par + Piz P2 = Pa + Paz and pa = 
Po, + Bye _ 

Furthermore Ppp= ps Q@=1—pys A—-QA z= 1ipp tent 
ap, t—ip,g+ 2p, ty = 2/4 and ty = rik 

The hmiting probabilities of states are p,, w0 308 py. ~ 0 208, 
Pu oer Pye 0082 p,, ~ 0091 po. 0032 ps, ~ 0 O87 and 
Pa. 

For the initial (nonmarkovian) system p, v0 616 p, v9 313, 
Py 0123 py wO048 Prey 0048 8 &0952 A w1904 2 
0703 r w0 219 t, 0352 and t, «0 110 

Comparing these data with the results of the preceding problem 11 46 
we infer that the system considered in Problem 11 46 has insignificant 
ailvantages over that considered tin Problem 14 45 as concerns all the 
efficiency characteristics and a little greiter advantage over an ele 
mentary queueing system with the same A and ny 

4147 Anelementary system without a queue and with unlimited assis- 
tance between the servers Customers arrive at an mn server congestion sys 
tem in a stationary Porsson process with intensity 4 The servers assist 
one another ie if some servers are :dle when a customer 1s being served, 
they all assist the busy server The intensity of the process 1s a function 
pp = @ {k) of the number A of servers who simultaneously serve him 
Construct the directed graph of states of the system and find its limiting 
probabilities of states Express the following efficaency characteristits 
of the system 1n terms of these probabilities the probabilit; of refusal 
Prep the relative capacity for service O and the average number of 


busy servers & Calculate these characteristics form = 4 4 = 1 p {4} = 
ku yp — 05 and compare them with the same characteristics in the 
ease wher bho serves de snot aesest goes aootter 

Solution When the first customer arrives all 2 servers begin serving 
him This means that all the servers always function as a single server 
The nserver system turns inte a single-cerver system with refusals 
Its states are sq all the servers are free s, all n servers are busy The 


P 


Ch. 11. The Queueing Theory 40% 


marked directed graph of states is shown in Fig. 11.47. Using this graph, 
we get the limiting probabilities of states: 


_ NH j-1 = g(n) A = yy 
r=ltooy} payee? poy Po GaEE 
For @ (”) = nu we have py = (np)/(mp + A), py = A/(mp + A). 


Forn = 4,4 = 1, p = 0.5 we have py = 2/8, p, = 1/3, Prep = Py = 
1/3, @=1—p, = 2/3 and A = dO = 2/3 & a 
0.667. 

The average number of busy servers k = So Se 
4-4/3 + 0-2/3 = 4/3 ~ 1.333. We get the same ¥(7) 
result by dividing A by wp: k& = (2/3)/0.5 = 4/3. Fig. 11.47 


For the sake of comparison we calculate the 
same efficiency characteristics for a four-server system without a mu— 
tual assistance between the servers [see Erlang’s formulas (11.0.6) andi 
formula (41.0.7) which follows from them] for p = A/n = 2 


Po = {1 +9 + 97/2 + 93/6 + 91/24}-1 = 1/7, 
Pret = Pa = (2/3) (1/7) = 2/21, A =A(A — 2/24) ~ 0.905, 
Q=A, k=Alu w1.81. 


Comparing these characteristics with those obtained earlier for 
a system with assistance between the servers, we infer that in our con~ 
ditions the assistance is not profitable. This is because for a system with, 
refusals an unlimited assistance (when all the servers “fall upon” one: 
customer while the customers who keep arriving are refused) is never 
profitable. 

11.48. An elementary system without a queue and with a uniform mutual’ 
assistance between the servers. Customers arrive in a process with in- 
tensity 4 at an elementary n-server system with refusals. The servers. 
assist one another but not by combining their efforts to form a single- 
server system, as was in the preceding problem, but by the uniform 
assistance scheme. Thus if a customer arrives when all m servers are 
idle, all of them begin serving him; but if another customer arrives: 
When the first customer is still being served, some of the servers begin 
serving the new arrival. If another customer arrives whilst the first. 
two are being served, some of the servers start serving this new arrival, 
and so on till all n servers become busy. If they are all busy, the next 
customer to arrive is refused. The function p (k) = kp, i.e. & servers 
serve A times quicker than one server. 

Construct a marked directed graph of states of the system and find 
the limiting probabilities of states and the efficiency characteristics. 
?, A, k for n = 4, =1, u=0.5, i.e. on the hypothesis of Prob- 
lem 44,47. Compare them with results for the absence of assistance*). 


It i on this problem it is irrelevant how many servers begin serving a new arrival. 
atrivin y relevant that all n servers function all the time and that not a a 
ahaa § customer is refused until n customers have arrived in the system and all n 
s“rrers are serving them individually. 
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Solution. The states of the system are enumerated in accordance 
with the number of customers present in the system The directed 
praph of states 1s shown in Fig 1148 The graph 1s the same as that 
for an clementary, one serser system with capacity p* = ny and a 
bounded queue which has n — f places To find its characteristics we 
use formulas (11 0 16) (11019) Setting p = p* = Afw* = Af(np) = 
05, we have for m = 3 

i--p* 05 


Po- Tapp tooe © 014, p, =(p*)'pg ze 0 032, 


Azik(—p,) 70968, Q=1-—-p, 70968, A = A/p* w 1 936 
Under the same conditions (see Problem if 47) with no assistance 


fe 


gehave d w0900 @ w~ 0905, 4 wi 81, ie a “uniform” assistance 


2 2 2 5) 2 
cj-mary tee ses 
ri fe fife fife nye rye 

Dig ft 48 


increases somewhat the capacity of the system for service In this case 
the increase 1s insignificant since the load on the system 1s not very 
large 

11 49, We are given in elementary three server system with refusals 
and parameters ? = 4cust/min The average service time of a customer 
served by one server 1 » = O05 min the intensity of serving a customer 


hy k servers p (A) = Au Find the efficiency characteristics @, A, A for 
three variants (1) no assistance, (2) unlimited assistance and (3) unt- 
form assistance 

_ Answer (1) @ O79 A w3 16,4 w1 58, (2)0 = 06, A = 24, 
&=12 (3) 0 0887, A w35i, kw 1 76 

1150 An elementary system with an unbounded queue and assistance 
between the servers Customers arrive at an elementary m server queueing 
system in a process with intensity A, the service time of a customer by 
one server being eAponential with parameter 4 The intensity of the 
service process of a customer by A servers 18 proportional to #, re 
—p (kK) = ku The servers are arbitrarily distrrbuted aver the customers 
in the system but if at least one customer 1s present in the system, then 
all ” servers are busy serving him 

Numbering the states of the system in accordance with the number 
of customers in it, Construct a marked directed graph of states, find 
the limiting probabilities of states and calculate the efficiency charac 
teristics A oz or, ty, ¢, 

Solution The directed graph of states of this system coincides 
with that of an elementary single server system with ‘1 unbounded 
queue with the intensity of the arrival process 4 and service process np 
{see 110, item 2) 
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Setting p=*x=A/(np) in formulas (11.0.12)-(11.0.15) we get py = 

4{—x,pp= ue A—x) (kA =1, 2,...);2= 24/1 — x), r= ¥/1 — 
a Y) ¥," 
%) ty = FG x (i—x) * 

In this case the efficiency characteristics of the system do not depend 
on whether all the servers serve one customer or whether their services 
are distributed uniformly since no customers are refused (note that in 
this case the mean values of the random variables Z, R, Ty, Tq do 
not vary but their distributions change). 

11.51. An elementary system with a bounded queue and uniform mutual 
assistance. Customers arrive at an elementary queueing system with 


and ty = 


A . 
Tye nyt 


i; aca a A 8 
8 | LO oe Ey re 
nfe nye if nye 
Fig. 11.51 


n serves and uniform assistance in a stationary Poisson process with 
intensity A. The service process rendered by one server is stationary 
Poisson's with intensity u, while the total service process rendered 
by k servers has intensity @ (k) = ku. The servers are distributed over 
the customers uniformly in the sense that every new arrival gets service 
if there is a free server. A customer who arrives when all 7 servers are 
busy joins the queue. There are 7 places in the queue; if they are all 
occupied, the customer is refused. 

Numbering the states of the system in accordance with the number 
of customers in it, construct a marked graph of states of the system and 
find the limiting probabilities of states. Find the efficiency charac- 
teristics of the system Prep, @, A, 2, 7, ty, tg: 

Solution. The states of the system are: 

So—the system is idle; 

S;—one customer is being served by all m servers; ... ; 

S,—k customers are being served by all m servers (i ck <n); ... ; 

Ss, ——n customers are being served by m servers, there is no queue; ... ; 

S,+,;—7 customers are being served by 7 servers and one customer 
is waiting to be served; ... ; 


? 

Sy+m—m customers are being served by 7 servers, m customers are 
in the queue. 

The directed graph of states of the system is shown in Fig. 14.54. 
This graph coincides with that of an elementary single-server system 
with m places in the queue, the intensity of the arrival process 2% and 
the intensity of the service process nu (see {1.0 item 3). Substituting 
4=A/(nu) for 9 and n +m for m in formulas (11.0.16)-(11.0.20), 
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we obtain 
Pa = — x — 2), op, = x*pye (A = 1,2... +m), 


Pret = Panam: ? = if — Pa+my A= MQ, 
Fe ye [fL—xhtrt (nfo 1 (n-t mi) x)] 


=m) my 
r+ hk, tyselh, tqerld 


11.52. The input of the automated data bank receives A=- 335 rec- 
ords/h on the average The first operation when a primary documents 
arrive 1s to select the records which must be fed into the data bank 
Six sorters select the records, the average productivity of each being 
» = 60 records/h It is Known that 61 3 per cent of the primary docu- 
ments are Selected, on the average, from the arrivals Al! the processes 
are stationary Poisson’s Considering the selection system for the pri- 
mary documents to be a six-server system (nz = 6) with an unbounded 
queue, find the efficiency characteristics A, Q, Ay 2 Fr tvs f 

Solution Since the queve is unbounded, @ = 1 and A =A The 
intensity of the arrival process of primary documents to the data bank 
Ap = Ap, where p ~ 0613, 1e Ay = 3385x0618 = 205 records/h 

The intensity of the arrival process of those documents which vill 

not be fed into the data bank A,j. = 4 (i — p) 130 records/h. 
_ The average number of sorters busy with selecting the documents 
& = a/v = p = 558 and does not depend on the number of servers 
(sorters) There 1s a stationary situation in the system if the condition 
* = Af(nmp) <i, is fulfilled, in our case it 1s fulfilled (x = 0 93) 

The probability that all n sorters in the system wall be busy [see for- 
mula (11 0 22}] 1s 


P,=P(n, py [ R(x, p)+P(n, p) z=]. 
Using the tables in Appendices 1 and 2, we obtain 


De= 0.15841 { 0 6703 +0 1584 aor) ~ 0 0369. 


_ The average number of primary documents im the queue [see (11 0 23)! 
r= p,xi(1 — x)’ 108 The average queueing time of a document 
fy = r/A et 87 min The average number of documents im the system 
(In the queue and being processed) z = r -++ p 15 38, The average 
waiting time of a document it, = Tq + 4/u a2 87 min 

11.53. Demands arrive at the input of a queveing system (Fig i! od) 
In 4 stafiopary Porsson process with intensity 4 The service consists 
of two successive phases performed im system 1 and system 2. A demand 
Is served in system 1 and the quality of the service is checked in sys 
tem 2 If no faults im the service are detected by system 2, then the 
demand 1s considered to have been served by the queueing system, if 
system 2 detects faults in the service of a demand, the demand 1s sent 
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back to system 1 for reservice (see Fig. 14.53). The probability that 
a demand served in system 4 will be returned to system 4 for reservice 
is 1 — p and does not depend on how many times it has been served 
in system 1. 

Systems I and 2 are 72,-channel and 7,-channel systems with unfound- 
ed queues and Service intensities in each channel of p, and 1, respective- 
ly. The time needed for reservicing a demand in a channel in system 4 
and for the retesting the quality of service by a channel of system 2 





have exponential distributions (the same as when these operations were 
carried out for the first time) with parameters pt, and u, respectively. 
Find the conditions for a stationary situation in this queueing system, 
assuming that the demands arrive at system 4 and system 2 in stationary 
Poisson processes. 

Solution. We denote the arrival intensity at the input of system 1 
by 44. It is evident that 4, => A since the input of system 41 receives de- 
mands arriving at system 1 for the first time (the intensity of the pro- 
cess is A) plus demands returned for reservicing (see Fig. 14.53). If 
a stationary situation exists, then the arrival intensity of demands 
Served in system 1, Ao, is equal to the intensity A,. The demands served 
by system 4 arrive in a flow at system 2 and, consequently, the input 
of system 2 receives demands arriving in a flow with intensity A. = 
Ay = A,. Since there is a stationary situation in system 2, the intensity 


~ the departure process of demands from system 2 (Ayo) is also Ap. 
1s 


dy = Mor = ho — Neos (44.53.1) 


Evidently, the intensity 4, of the departure process of demands which 
have been served in a queueing system at steady state is equal to the 
intensity 4 of the arrival process. 

The intensity 4%, with which the demands are served in the 
queueing system is equal to that at the output of system 2 (App) 
multiplied by the probability p that a demand will not be returned to 
system i for a repeated service: 


NoaP — Ko — hs (14.53.2) 
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whence we hare 


hog = Alp (11 53 3) 
Thus [sce formulas (11 53 1) (11 53 3)] 


For the queveing 53stem 8 operation to be steady state, 1t 15 necessary 
thit both system 1 and system 2 should succesafully handle all the 
arriving demands and, consequently, the following two conditions 
should be fulfilled 


%, = Agi(nypy) = AM(prypy) <2 1, (11 53 5) 
He — Agf(gu.) = A/(PRolt,) < 1 (41 53 6) 


They follow from the fact that system 1 and system 2 are n, channel 
and r, channel systems with channel service intensitics p, and it, 
respectively and with an unbounded queue (see ttem 4 at the beginning 
of this chapter) 

{i 54 For the conditions of the preceding preblem find the average 
wailing time of a demand and the average number of demands present 
In the system 

Solution The iwerage time a demand 1s present in system 4 for the 


first time f, (see Fig 11 53} can be found from the condition that de- 
mands arrive it the input of the system in a stationary Poisson process 
with intensity A, = A/p the number of channels 1s pr,, the intensity 
of service rs p, and the number of places in the queue 1s unlimited 
In accordance with (41 0 21) 4141 0 25) we have fer these conditions 

= —_ ait 

f= (Pi tri) At — + pi Por (14 54 4) 


Hy ry yt (1 %y)}? Ay! 





where 
i _ py _ A 
ape Ma 





== Pi PE em, prt tat 
Pot [1+ qty tt mA <x} ‘ 
By analogy we calculate the vartable ¢,, which 1s the average time 
a demand 1s present in system 2 for the first time for the conditions 
A, = A/p omg and yp, 
4. (0, £7.) Reb ae pet Pos 42 
fa MPa Fhe) Ag = Hs + Rg Nal (L—%y}2bq ” (115 


where 





A h 
Pg = + — he = 


Ply * a ae " 


_ 2 | 2 ope, opeett 4 4-8 
Poo=|4-+fe+S 4. veh a hal — | 


ity 
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Consequently, the average time needed for a once through service 
‘a demand by system 4 and system 2 


Tom t, + t,. (14.54.3) 
It follows from problem 11.53 that a random variable X, defined as 


the number of times a demand is served by system 1 and system 2, 
has a geometric distribution beginning with unity with parameter p: 


an Bt 2 eon ee cae 


: (14.54.4): 

p |pa|pa?| ... | pak]... 
We denote the time of the first, second, ..., the &th cycle of pro- 
cessing a demand in system 1 and system 2 by 7;, 7., ...; Try ..-.- 
By the hypothesis the random variables 7,, ..., T,, -.. are mutu- 


ally independent, have the same distribution and the mean value Lory 

We can write an expression for the time a demand remains in the 

queueing system (with due regard for the possibility that a demand is 
x 


returned for reservice) in the form 7 = >) Tj, i.e. the sum of a random 


R= 
number of random terms, where the number of terms X does not depend 


on the random variables 7,, T., T3, ... . In accordance with the 
solution of Problem 7.64 we find the mean value of the variable 7: 
t= MIT] = MIT,) MIX] = %,/p. (14.54.5) 


Little's formula is also valid for the queueing system we have con- 
sidered, and, therefore, the average number of demands present in the 
system can be found from the formula 


z= th. (14.54.6) 


11.55. The conditions of Problem 44.53 are changed so that in both 
system { and system 2 a demand is served for the first time and the 
quality of service is checked. If a demand does not pass the check in 
system 2, it is sent to system 3 for a reservice and to system 4 for re- 
checking (Fig. 11.55). System 3 and system 4 are n3-channel and n,-chan- 
nel systems with exponential distributions of service time of demands 
in the channels and with parameters jt, and w, respectively. The proba- 

lity that a demand processed in system 3 wil] be returned to system 3 
alter the check in system 4is 1 — x. Find the conditions for steady-state 
operation of this queueing system, assuming that the demands arrive 
al system 1, system 2, system 3 and system 4 in processes which are 
stationary Poisson’s. 

Solution. When there isa stationary situation In the queueing system, 
the following relationship is obvious (see Fig. 14.55): 


A = Ay = hoy = ho = Aga (44.55.4) 


Consequently, the intensity of the departure process of demands which 
ave been served for the first time and checked in systems 4 and 2 is Ap. 
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The intensity of the process in which the demands that have not passer 
the chech 1n system 2 arrive for reserving at system 3 and system 41 
A {1 — p) The operation of the reservice system (system 4d and sys 
tem 4) (from point 1 to point 2 in Fig. 11 55) does not differ in principli 
from the operation of the system considered in Problem 11.53 





femangds serf for reserrvice 


| 

oyster I Syston 4 
OE ae Pet 
| 
| 


| anf p= FOB) iy oy) 


Thus the following conditions must be fulfilled simultaneously fo: 
the stationary mode of operation of the system considered in thr 
problem 








“= sh eS a <1, =a 
"= CoP) <1 (11 55 2 
In addition, the following equalities wull hold true (see Fig. 11 59) 
hg = hog = hy = og = 2 — p) et (14553 


11 56 For the conditions of the preceding problem find the averag 
waiting time ¢ of a demand and the average number of demands 
present in the system 

Solution. The average waiting time of a demand can be found fror 
the condition that demands arrive at the input of the system in 4 8t2 
tionary Poisson process with intensity A, —A [sea Fig 11 50 and for 
taula (14 55 1)1, the number of channels 1s n,, the intensity of Service 1 
a channel 3s p,, and the number of places in the queue 15 unlimited 
in accordance with (11 0 24) (11 0 25), we have for these conditions 


—_ = ayti 
By = (Pp ery) Art ae DP Pat (11.56.4 


Hy ryt] (t-—%,}" A 
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vhere 


A Px 
—-—— » 7 — 
Py Hy ’ i ny 3 


_ Pr PR 7 ; ot! pm 4 = | 
por 1+ 4+ e +S 4+ BS]. 


3y analogy we calculate the variable t, for system 2 at A, = A, Ry and 
lo, 1.8, 





a = Neti 
RT en ye ere eee a! (1.56.2) 


NaN! (1 —%o)*h ; 
vhere 


A Do 
ee En % —— ee 
Po = ly? 2 no’ 








=(14-848 4. mae pz” as Sa 

Po = 4| 2} No} Nana! L—%, 

fhe average waiting time of a demand in system 1 and system 2 
Tigi, +t. (14.56.3) 


The average time t, a demand is present in system 3 for a once through 
ervice can be found by assuming that demands arrive at the input of 
his system in a stationary Poisson process with intensity A, = 
.(1 — p)/n [see Fig. 11.55 and formula (41.55.3)], the number of 
channels is mz, the intensity of service in a channel is 3, and the num- 
ber of places in the queue is unlimited. Then, in accordance with 
(14.0.21)-(11.0.25), we have 


Ib = (03 +s) AT? = Alps + PR+1pog/[ngn3! (1 — %5)* Al, — (11.56.4) 


where 


_ As _ AC—p) ieee 
alt Rr 


nh 





{ 
7 Ds ph p 3 ore |" 

Pos = [1+ 21 sal: wr ga Ngngl 1%, 

By analogy we calculate the variable t, forsystem4ata, =’ (1 — p)/x, 
na, ilas 


3 


ty = (0, -b Ty) At = Wt, + OF pos! [yn,! (L—x)2 Ag]p (11.56.5) 


There 


{ 
_ Dp, ae ; ; oy! pret { 
Po =| 1-+-ft+ 2! = — ngl reg! 1—-%, : 





Vi-~os75 
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Consequently, the average time per demand processed once In system 3, 
and <,<tem 4 


tet Es, (11 56 6) 


In accordance with formula ({f 54 6), the expectation of the watting | 
time of a demand in system 3 and system 4 (See Fig 1156), with due 
regard for possible reprocessing, 1s 


Ty = THe (44 56.7) 


To find the average waiting time of a demand in the queueing 
system, we consider two hypotheses (f) #,, the demand was only 
processed once P (#H;) = p and (2) H,, the demand was processed 
many times, VP (#f,) = 1 ~— p 

On the hypothesis H, the expectation of the waiting time of a demand 
in the queueing system can be found from formula (11 56 3}, on the 
hypothesis ff, the expectation can be found from formulas (11 56 7} 
and {14 56 3) The complete expectation of the waiting time of a de- 
mand in the system 


batt TH (1 — pyre (11.56 8) 

7 erage number of demands present in the system can be found 
formuta 

z= fA, (11,56.9) 


-~Let us consider the formulation of Problem 11 53, as applied 
multi fold precessing of information in two phases To check 
* an input card has been correctly punched, the punching 1s per~ 
formed twice ona punch unit and on a verifier, which can detect an 
error The punch unit operator makes one error per 1000 symbols on 
the aversge Each punch card contains an average of 8SOsymbols When 
at least one error ts detected on a punch card the card 1s returned for 
arTepunching I[t 1s necessary to process 50000 documents in a year, 
each of which contains an average of 400 symbols 
Find the minimum possible number of punch unit and verifier oper- 
ators needed if one pusich unit operator punches 4 2 * 10° symbols 
a vear and find the characteristics of the system 
Solution It follows from the conditions of the problem that an 
average of 50000 x 400/80 = 250000 cards must be punched and 
verified per year Consequently A = 250000 cards/year = 125 cards/h= 


2 O83 The productivity of a punch unit or verrfier operator 
18 “80 == 52 x 5000 cards/year = 26 25 cards/h = 
) ‘ bability that no errors will be found on @ 


ac 9 In this case we neglect the prababilit3 
and the verifier operaters will err at the 
is much smaller than (0 001)? = 10 © 

14 and the vermfer has about 50 sym 

‘ be introduced by pressing any one 
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keys, then we find that the probability of the same error is 
If we assume that an error can only be introduced by pres- 
neighbouring the correct symbol (of which there are from 
ht), then the probability is 10-8/25-10-°/64, 

lonary operation of the punch-unit operators [see (14.53.5), 


M(Myfyp) = %,<41, A/(nepep) = % <4, 


> A/(p yp) = 290 000/(52 x 500 x 0.9) = 5.29 and n, > 5.29. 
e must have six punch-unit operators and six verifier oper- 


aracteristics of the operation for the punch-unit operators: 
p = 250 000/0.9 = 278 000 cards/year, ny = 6, p, = 52 X 
s/year, *, = A/(mpp) = 0.882 and} p, = A/(pp,) = 5,29. 

3 formula (141.0,22) to find the probability that all the six 
it operators are busy and there is no queue of documents 


ust bey punched: 





P (m4, 0) we te ANT 
7s 0.882  — """ 
Ring, Pa) +P (my, Ps) Foz 0.2824 0.152 -— Fas 


rerage number of cards waiting to be punched 7, = p,,.x,/(1 — 


verage queueing time of a card 2 = 7)pi~! = 2,92 min and 


+ 4/n, = 5.21 min. _ 
> number of cards in the first phase 2, = 7, +k, =7, + 
the characteristics of the second phase (verification) are the 
those of the first phase, we can write the genera] characteristics 
speration of the system with due regard for the possibility that 
ay be returned for repunching. The overall average number of 
‘esent in the system z = 2z, = 24.14 and the number of these 
1 the queue r = 2r, = 13.56. The overall average processing 
x card, with due account of the possible return of a card for 


ssing, £ = 1,./p = (, + t)/p = 2t;,/p = 14.57 min. 
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Probabilities” Fi (m, a)-1—R(m,a)=1— 3) Ser 
h=0 


9 5163-2 
4 .6788-5 
1.5465-4 
3 8468-6 


4.842771 
4.75237? 
4 .1485-° 
5 .6840-5 


2,.2592-° 








2.59187? 
3 .6936-* 
3.5995-8 
2,.6581~4 


4.578575 


2.0502-° 


3.296871 
6.45527? 
7.926378 
7.7625-+ 


6 .1243-° 
4.0427-° 


4.8172-° 


a=0.6 a= 0.7 a= 0.8 a=0Q0.9 
4.514971 5.034177 5 5067-4 5.934371 
4.2190 4.5580 4.9121 2.2102 

2.31157 3.41427? 4.74237 6 2857-7 
3.358173 5.753579 9.079973 4.3499 

3.9449-4 7.855474 4.44113 9.344178 
3.885675 9.00265 4 843474 3 .4349-* 
3.293175 8 883676 9 .07477° 4.3401-© 







on onwr wWNr & 


ee 


R(m-1, a)-R(m, a) (m 





6.321274 
2.6424 
8.0301-2 
1.8988 


3.6598-8 
5 9418-4 
8 3241-5 
1.0219 

1.425276 


am 
*) P(m, a= e 


8.646677 
5.9399 
3.2332 
4.4288 


5.26537" 
1.6564 
4 5338-8 
4.0967 
2.374574 


9 502177 
8.0085 
5.7681 
3.5277 


4.8474 
8.3918"? 
3.3509 
4.41909 
3 .8030-° 


-—@ can be found jn terms of Rim, 


> 0), P(0, = {—-R(0, a) 


9 816877 
9 0842 
7.6190 
5.6653 


3.74116 
2.4487 
4.4067 
5.441347? 
9, 1363 


R 
) 
on 


9.932677 
9 5957 
8.7535 
7.3497 


5.5951 
3.8404 
2.3782 
4.3337 
6.80947" 


a) as follows: Pi(m, 4)= 
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Cantinyed 

g & 6498-5 { 1025 8 1329-3 3 1823 
10 8 2082-5 2 9234-4 9 8353 1 3695 
11 1 3646 7 138775 9 1523-4 § 4531-2 
{2 1 #149 2 7372 2 ais9 
i3 3 40f9-% 7 6323-5 6 9799-4 
14 1 9932 2 2625 
15 4 8996-4 6 9098-6 
16 { 1328 t 9969 
17 5 4163-6 
#8 1 4017 
m | ane a=] a = 8 au 9 aw i0 
Oo [ 9 9752-1 § 9909-5 9 9986-1 9 9999~! ) 9995~ 

1 | 9 8265 9 9970 9 9693 9 9377 9 9950 
2 | 9 3893 9 7036 9 $525 9 9377 § 9723 

3 | 8 4880 9 1823 9 5752 9 7877 9 8966 

& 7 1694 8 2701 9 0937 5 4504 4 TOTS 

5 | 5 5432 6 9929 8 0376 8 8431 5 3291 

& +} 3 9370 5 5029 & 8663 7 9922 8 6938 

7 | 2 5602 4 0129 5 4704 6 7610 7 7978 

8 | 4 5276 2 7091 4 0745 5 4435 & 6718 
9 | 8 3924-2 1 4930-1 2 8339-1 4 12593 5 4207-1 
10 | 4 2621 9 8521-2 t 841 2 9,01 4 1696 
11 | 20092 5 4350 1 1192 i 9099 3 0322 
12 | 8 8275-3 2 7000 6 3797-3 { 9493 2 O344 
if | 3 6295 t 23% 3 4f8! 7 3951-3 { 355% 
44 | 4 4004 § 717273 1 7257 4 1486 8 3453 3 
15 5 Od10-« 2 4056 8 2310-3 2 2036 & 8740 
16 | 4 7485 9 4318-4 3 7180 1 1106 2 7042 
17, | 5 6917-8 3 8173 1 5949 5 3499-9 { 4275 
148 | 4 7597 { 2935 6 5037-4 2 4264 7 1863-3 

ao OE 

199 | 5 1802-8 | 4 4400-8 | 2 529% 1 0360 3 4543 
20 ( 4 4554 1 4495 9 3963-4 4 3925-4 1 5333 
21 4 5263-8 3 3407 1 7495 6 9965 4 
22 1 3543 { 1385 6 6378-5 3 9574 
23 3 7255" 2 4519 1 2012 
24 49722 8 85317° 4 6949-3 
20 * O414 1 7830 
56 6 4220-* 
oT 9 9535 
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Example. We must find the probability th e 
than twice if @ = 7. Pp ity that an event A will occur no more 


We have 
R(2,7)=1-—-R 2, DO = 4 — 9.70361 = 1 — 0.97036 = 0.02964. 
Remark. {. If a number in the table has no exponent, then the exponent of the 


previous number in the column i . _ 
1.9067 xX 4073. n is the exponent. For example, R (33, 19) = 


9 For a ~> 20 the probability R (m, a) can be approximated by 


R(m, a) x ® (=) 1.0.5, 


where ® (x) is the error function (Appendix 9). 











0 | 9.9998-1 9 9999-1 

1 | 9.9980 9.9992 9.999771 9.99997! 

2 | 9.9879 9.9948 9 .9978 9 9994 9.999672 
3 | 9.9508 9.9771 9.9895 9.9953 9.9979 
4 | 9,8490 9.9240 9.9626 9 9819 9 9914 
5 | 9.6248 9.7966 9.8927 9.9447 9.9721 
6 | 9.2139 9 5418 9.7414 9.8577 9.9237 
7 | 8.5684 9.1050 9.4597 9 6338 9 8200 
8 | 7.6801 8 4497 9.0024 9 3794 9.6255 
9 | 6.5949 7.5764 8 3449 8.9060 9.3015 
10 | 5.4011 6.5277 7 4832 89432 8.8154 
{14 | 4.2073 5 3840 6.4684 7.3996 8.1525 
12 | 3.4130 4.2403 5.3690 6.4154 7.3239 
13 | 2.4874 3.1846 4.2696 5 3555 6.3678 
14 | 4.4596 9.2798 3.2487 4.2956 5 3435 
15 | 9.2604-2 4.5558 2.3639 3 3064 4.34194 
16 | 5.5924 4.0129 1.6451 9, 4408 3.3588 
17 | 3.2194 6.296672 4 .0954 1.7280 9.5114 
{8 | 4.7687 3.7416 6.983372 4.1736 4.8053 
19 | 9,2895-3 2.1280 4.2669 7.650572 4.2478 
20 | 4.6744 4.1598 9.5012 4.7908 8.297278 
21 9.9519 6.065173 4.4034 2.8844 5 3106 
22 | 4.0423 3.0474 7.622573 1.6712 3.2744 
a3 4.638674 4.4729 3.9718 9 .3276-° 4.9465 
24 | 4.9374 6.856372 4.9943 5.0199 1.1165 
25 | 8.205075 3.0776 9.660374 2.6076 6.184973 
26 | 3.2693 1.3335 4.5190 4.3087 3.3119 
27 | 4.2584 5 583675 9, .0435 6.351373 4.7158 


28 | 4.6847-5 | 2.2646 8.9416 2.9837 
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Centinued 

‘7 | a<=it | aan i | ge=1J am jh a5 
29 1 BSE2 8 8701-9 3 7894 1 3520 4,41845 
ot) 3 3716 1 5568 5 9928-5 4 9731 
31 1 2492 & 2052-5 2 woo G 0312-5 
32 2 4017 1 0675 4 0155 
33 4 315475 1 7356 
34 1 $968 7 2978-4 
35 2 98Ti 
36 | 4 4346 
dem 16 | oe 17 | a=18 | tm_if | a= 70 
0 

| 

Z g HgG-i ogg 

3 9 9991 9 9996 g Og58-1 9 999-1 

4 § S$OB0 9 9982 § 9992 9996 9 9993-1 

hi) 9 9862 9 9933 9 00688 9 9985 9 9994 

6 9 9599 § 9794 9 S96 9 9948 9974 

fl 9 9000 9 9457 ood 9 $849 9 9922 

5 9 7EQI 9 8740 § 9294 9 9613 9 979] 
9 9 5670 9 7333 G S462 9 Htt4 § 9500 
10 9 2260 9 $088 9 6963 9 $103 9 8919 
41 8 T7201 9 1533 9 45tt S 6533 G 786 
42 8 0688 & §498 9 0833 G 3944 9 6099 
13 F 2040 7 OO70 6 5740 3 Dibd § 3387 
14 Gi 3247 7 1917 7 {92 § 5025 5 9514 
1S H aah 6 2855 7 4335 7 8521 & 4349 
16 4 3404 0 3226 G 2495 7 O797 7 7893 
i? | 3 4066 4 3598 5 34135 6 2164 7 0297 
13 2 5765 4504 4 4776 a 3052 6 1858 
49 41 8775 2 6368 3 4908 4& 3939 5 2974 
ep i 3i83 { 9442 Z 6925 6 3283 4 4097 
21 ¢ 8 9297-2 1 3853 2 0088 2 7450 3 5620 
22 5 8241 9 5272-7 1 4491 2 Oba7 2 7939 
23 ¢ 6686 6 3296 41 41% 1 5098 2 4251 
24 2 245 & W646 6 S2to-* 4 O6iS 4 5677 
20 1 3149 2 5240 4 4608 7 3126-3 1 1218 
26 7 4569-3 1 5174 2 6234 4 6257 7 1oai74 
ai 4 154 8 8335-3 4 7318 3 1268 5 2481 
28 2 LEER 4 9833 1 0300 1 9536 3 4534 


as 


aoc pietetl 
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Continued 
m a= 16 a=17 | a == 18 | a= 19 | a = 20 
29 | 4.1342 2.7272 5.9443-3 1.1850 2.1848 
30 | 5.6726-4 1.4484 3.3308 6.9819-3 4 3475 
31 | 2.7620 7.470874 4.8133 3.9982 8 0918-9 
32 | 4.3067 3.7453 9 597574 2.2267 4.7274 
33 | 6.0108-5 4.8260 4.9416 1.2067 92.6884 
34. | 2.6903 8.664475 2.4767 6.367474 4 .4890 
35 | 4.4724 4.0035 4.2090 3.2732 8.036674 
86 | 4.977278 4.8025 5 7519-5 4.6404 4.2290 
37 | 2.0599 7 .9123-6 2.6684 8.015475 2.4708 
38 3.3882 4.2078 3.8294 4.0875 
39 4.4462 5 3365-6 4.7797 5 3202-5 
40 2.3030 8 .0940-8 2.5426 
ai 3.5975 4.4877 
42 4.5634 5 4252-8 
43 9.4243 
44 4.0603 
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APPENDIX 3 


The Vatlues of the Function e-* 


s fet) a jf xe for {| a fs | A 





0600/4000] 10 104010 670] 7 > 8 )0 449 4 

O0t19 990; 10 fF041/0 664] 7 Fost |O 445] 5 
02] g30; 10 42] 657| 7 821] 4401 4 13 20 
03 970 f} 43 650] 6 a3 436 4 433 
0+ 961] 10 44 644) 6 84 432 > # 3 40 
05 951 9 45 633) 7 85 427 4 nh 
O04 9,2) 10 46 631 6 56 423 4 {3 69 
O7 932 9 47 635[ 6 Si 415 4 70 
O$ | 923) 9 435; Gid] 6 88] 415] 4 | 3 80 
a9) a4] 39 49] Gi3| 7 so! 4t1] 4 I 3 G0 

G igo 995 j id 5050 85; 6 gi 90 (0 407 4 (0 
ti §96 9 51 60d) 5 9] 43 é 16 
12 837 9 52 2954) & 92 393 4 20 
13 873 LM 5a 359! § G3 499 A ha W 
14 859 8 Se asa! § 4 391 4 40} 
15 S61 G 5 Bit 6 95 337 4 30 
16] 8:2] 8 56] S711 6 95; 393} 4 | 4 60 
17 R44 9 57 3657 5 97 379 4 70 
i8) 835! 8 53 960/ 6 93 | 375 3 80 
19 27 8 oo 994] 5 99 3T2 4 90 

020/0819/ 8 |}O 8680/0 549] «6 1001036351 35 00 
21% 814 g G1 943[ 5 {10 |] 333) 31 10 
22 | 803] 8 62} 533] 5 | 420} 302] 29 20 
23 "$a 4 43 $33, & { 30 Zia) 26 30 
oA ia fs) 64 ee 5 1 40 247) 24 40 
25 | 779) 8 65 { 622] 5 150 [ 2237 21 ol} 
26 Til & GG aay) 65 41 60 a2) 49 Gi) 
27 763 fj G? siz 5 1 70 isa; 48 70 
231 756] 8 63 507] 5 1 80 165] 45 80 
29 745 fi 69 B02) 5 1 90 159} 15 9) 

030 )0 74; § £07010 497) 5 |e¢oqglo435| 13 00 
31 733 7 71 492] § 240] 1422[ it id 
32 726 7 72 437) 5 2 90 441) 41 20 
33 719 7 ri} 452] 45 32 33 193 9 3 
34 712 a T4 Aly 5 2 4010 091 9 40 
35 | 70a| 7 7a | 472] 4 259 B2/) & 30) 
36 693 ¢ 76 453) 5 2 OO 74 7 id 
a7 691 7 fri 463} 5 2 70 ivi G 70 
33 634 7 78 405) 4 2 80 61 6 &) 
39 | 677 7 7 1] 454] 5 a a0 55 5 oO 

0 4010 673 d 0 8) | 0 449 3 09 |@ 039 


IM OB Oh be me on 


eee ee PS ee Pee BS BS ob CO ie ie Bs or on oe oo ey Ge co 


— 
Cont 
ae 
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APPENDIX 4 
The a of the Normal Distribution 
x2 
i (x) ~ o/ On 6 2 
x 0 2 3 2 | 5 | 6 | 7 | 8 | 9 
} 0.0 | 0.3939 | 39389 | 3939 | 3933 | 3936 | 3934 | 3932 | 3930 | 3977 | 3973 
0.1 3970 | 3965 | 3961 | 3956 | 3951 | 3945 | 3939 | 3932 | 399m | 3918 
0.2 | 3910 | 3902 | 3894 | 3385 | 3876 | 3867 | 3357 | 3347 | aaqq | 3825 
0.3 | 3814 | 3802 | 3790 | 3778 | 3765 | 3752 | 3739 | 3726 | 3749 | 3697 
10.4 | 3633 | 3668 | 3653 | 3637 | 3621 | 3605 | 3539 | 3572 | gss= | 3539 
0.5 3521 | 3503 | 3485 | 3467 | 34483 | 3429 | 3410 | 3391 | 3979 | 3352 
0.6 | 3332 | 3342 | 3292 | 3274 | 3251 | 323) | 3209 | 3187 | 3169 | 3144 
10.7 | 3123 | 3101 | 3079 | 3056 | 3034 | 3011 | 2939 | 2966 | 2943 | 2920 
0.8 | 2397 | 2374 | 2350 | 2327 | 2303 | 2780 | 2756 | 2732 | 9709 | 2685 
0.9 2661 | 2637 | 2613 | 2539 | 2565 | 2541 | 2516 | 2492 | 9468 | 2444 
1.0 | 0.2420 | 2396 | 2371 2347 | 2323 | 2299 | 2275 } 2251 | 9997 | 2203 
1.4] 2179 | 2155 | 2131 | 2107 | 2033 | 2059 | 2036 | 2012 | 4939 | 1965 
1.2 1942 1919 1395 1872 | 1849 | 1826 | 1804 | 1781 | 4753 | 1736 
1.3 1714 1691 1669 | 1647 | 1626 | 1604 | 1582 | 1561 | 4539 } 1518 
1.4 1497 | 1476 1456 | 1435 | 1415 | 1394 | 1374 | 1354 | 1334 | 1315 
1.5 4095 | 1276 | 1257 | 1233 | 1219 | 1200 | 1182 | 1163 | 4y45 | 1127 
1.6 1109 1092 | 1074 | 1057 | 1040 | 1023 | 1006 | 0339 | 9973 | 0957 
1 4.7 0940 | 0925 | 0909 | 0393 | 0878 | 0363 | 0848 | 0333 | 9348 | 0304 
1 4.8 0790 | 0775 | 0764 | 0748 | 0734 | 0721 | 0707 | 0594 | 9584 | 0669 
1.9 0856 | 0644 | 0632 | 0620 | 0603 | 0596 | 0584 | 0573 | 9562 | 0551 
9.0 | 0.0540 | 0529 | 0519 | 0503 | 0493 | 0433 | 0478 | 0463 | 0459 0449 
| 2.1 0440 | 0431 | 0422 | 0413 | 0404 | 0395 | 0337 | 0379 | 0371 | 0363 
2.2 0355 | 0347 | 0339 | 0332 | 0325 | 0347 | 0310 | 0303 | 0297 | 0290 
2.0 0283 | 0277 | 0270 | 0264 | 0253 | 0252 | 0246 | 0241 | 0235 0229 
2.4 0224 | 0219 | 0213 | 0208 | 0203 | 0193 | 0194 | 0189 | 0184 0180 
2.5 0175 | O174 | 0167 | 0163 | 0153 | 0154 | Otol 0147 | 0143 | 0139 
2.6 0136 | 04132 | 0129 | Of26 | 0122 | O119 | OL16 0113 | 0410 | 0107 
2.7 0104 | 0101 | 0999 | 0996 | 0993 | 0091 0033 | 0936 | 0034 ; 0081 
2.8 0079 | 0077 | 0075 | 0073 | 0071 | 0059 0037 | 0065 | 0063 | 0054 
2.9 0080 | 0053 | 0056 | 0055 } 0053 | 0051 0950 | 0043 | 0047 | 0046 
3.0 | 0.0044 | 0043 | 0042 | 0040 | 0039 0038 | 0937 | 0036 | 0035 | 0034 
3.4 0033 | 0032 | 0034 | 0030 | 0029 | 0028 0927 | 0926 | 0025 } 0025 
3.2 0024 | 0023 | 0022 | 0022 | 0021 | 0020 0920 | 0019 | 0918 ; 0018 
3.3 0017 | 0017 | 0016 | 0016 | 0015 | 0015 0914 | 0014 | 0013 | 0013 
3.4 0412 | 0012 | 0012 | 0014 | OOL1 | 9010 0010 | 0910 | 0099 ; 9909 
3.5 9009 | 0008 | 0003 | 0903 | 00038 | 0007 0097 | 0097 | 0007 | 9005 
3.6 0908 | 0006 ; 0006 | 0005 | 0005 | OJJa 0995 | 0005 } 0005 | 0004 
3.7 009% | 0004 | 0904 | 0004 | 0004 | 0004 0003 | 0903 | 0093 ; 0903 
3.8 9003 | 0003 | 0993 | 0003 | 0003 } 0002 0002 | 0092 | 0002 ; 0092 
3.9 0092 | 0002 | 0002 | 0002 {| 0002 0002 | 0002 | 0002 { 0001 | O00! 
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APPENDIX 5 


The Valuesoj the Error Function D(z) = 75 \ erdz 
0 





a 








T 


00 | 0 0000 | 00399 | 00798 | O1197 [01595 ) 01994 | O2392 | 02780 
0 1 03983 | 04380 | 04776 | 05472 | O5567 | G5062 | 06256 | 06749 
0 2 07926 | O8317 | O8706 | 09095 | 09482 | 09871 | 10257 | 10642 
03 44791 | 42172 | 12552 | 12930 | 13307 | #3683 | 14058 | 14434 
04 £5542 } 15910 | 16276 | 16640 | 17003 | 17364 | 17724 | 18082 
03 19146 | 19497 7 19847 | 20194 | 20540) 20884 | 21226 | 21566 
06 22575 | 22907 | 23237 | 23565 | 23894 | 24215 | 249537 | 24857 
O7 20004 | 26115 | 26424 § 26730 |] 27085 7] 2T237 | 27037 | 27935 
06 23814 | 29103 | 29389 | 29673 | 29955 | $0234 | 80011 | 3078S 
09 Si894 | 31859 | S221 | 32381 | 32639 | 82604 | 33447 | 33393 
1% $4134 | 343975 | 34614 | 34850 ) 5083 | 35314 | 35543 | 35769 
it 36400 | 36650 | 26864 | 37076 | 872e6 | 37493 | 37698 | 87900 
12 38493 | 38686 | 38877 | 39065 | 89251 | 39435 | 39617 | 39706 
ia 40820 | 40490 | 40655 | 40824 | 40983 | 41149 | 44309 } 41466 
14 41924 | 42073 | 42220 | 42364 | 42507 | 42647 | 42786 | 42922 
15 43319 | 43448 | 43574 | 43699 | 43822 | 43943 | 44062 | 44179 
16 44520 | 44630 | 44738 | 44845 | 44950] 45053 | 45154 | 45254 
17 45043 | 45637 | 45728 | 45818 | 45907 | 45994 | 46080 | 46164 
18 46407 | 46485 | 40562 | 46638 | 46712 | 46784 | 46856 | 46926 
19 47123 | 47193 | 47257 | 47320 ] 47384 | 47441 | 47500 | 47558 
2 0 47729 | 41778 | 47831 | 47882 | 47932} 47982 | 48030 | 48077 
21 45214 | 48257 | 48300 | 48344 | 48382 | 48422 | 48464 | 48500 
2 2 45610 | 48645 | 48079 | 48713 | 48745 | 48778 | 48£09 | 48840 
23 45928 | 46956 | 48983 | 49010 | 49036 | 49061 | 49056 | 49111 
2 4 49180 | 49202 | 49224 | 49245 | 49266 | 49286 | 49205 | 49324 
2% 49979 | 49396 | 49443 | 49430 | 49446 ] 49461 | 49477 | 49492 
2 6 49534 | 49547 | 49560 | 49573 }49585 | 49598 | 49609 | 49621 
27 49653 | 49664 | 49674 | 49683 | 49693 | 49702 | 49741 | 49720 
28 49744 | 49752 | 49760 | 49767 | 49774 | 49781 | 49788 | 49795 
29 49813 | 49819 | 49825 | 49834 | 49836 | 49841 | 49846 | 49851 
$0 | 6 49865 31 | 49903] 32 | 49931 | 33 | 49952 
ao 49977 36 | 49984] 37 } 49989 | 38 | 49993 
40 4999638 

49 499997 

o 0 49999997 





03153 
07142 
11026 
14508 
£8439 
2iD04 
20115 
28230 
o1057 
g2646 


35990 
38100 
aO073 
41621 
43006 
44295 
45352 
46246 
46995 
47615 


4B124 
48037 
45870 
49134 
49343 
49006 
49632 
49728 
49804 
49256 





03586 
OTS35 
11409 
15173 
18793 
2224) 
e040 
28524 
34327 
os591 


6214 | 
38298 
40147 
44774 
431839 | 
44408 
45449 
46327 
47062 
47670 


48169 
48574 
48899 
49158 
45364 
49520 
4964 


45736 
49807 
4986 


3 4 | 49966 
39 | 49995 


egy yyy 
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Appendiz 6 


Some of the Properties 
of Generalized Functions 


When solving problems dealing with random functions, it is often convenient 


to use transformations involving various step functions as well as generalized func- 
tions like the delta function. 


Here are the definitions and main properties of these functions of a real argu- 
ment T. 


14. | 7], a modulus (absolute value): 


t for t>0, 
it1={_f for t<O. 
2. 1 (t), a unit function (a unit jump): 
1 for tr>b, 
{(t)=4 = for t=0, 
QO for t<0O. 


3. sign t, the sign of the value of t (the signum): 
4 for t>0 
| 0 for t=O, 
—1 for t<0 
4, § (x), the delta function: 


§ (t)= = 1 (tT). 


The delta function ig an even function of t. The main properties of the delta 
function are 


(a) 16 (t) == O and, in general, p (t) 5 (t) = 0 if @ (t) is an odd function con- 
tinuous at t = 0; 


O+¢e 
(b) \ p (t) 6 (t) dt = ) (0) if the function 1p (t) is continuous at the point 
t= 0 (050); 
0 O-+-e ; 
\ p(t) 6 (t) dt = | p (tT) 5 (Tt) dt = — 1p (0) 
0 


0-e 


7 Nhe dctaiioes ee ee ea hold for any real t and 
any odd function 9 (t): 

(4) |tl==tsign t, (2) t=] | Sign t, 

(3) p (x)= (| t [) sign t, (4) (| T]) = (+) Sign Tt, 

(5) p2(| t |) =? (x), (6) sign tT=2-1 (t)—1, 


(7) 1 (ye 


(B) | t {= [2 1(t)—4}, 
alt | 


(9} qa = Sign T, 
aqiitt @signt 
(10) yea a POU 


T T 
(14) 1 (t}= { § (1) dt \ d (sign ) 





. Var e~@IT! (cosh Bt 


. Var (i—|tihi(i—|tl), where 
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APPENDIX 7 


A fable of the Relationships Between Various 
Correlation Functions R, (x) 
and Spectral Densities S* (o) 














R,. (1) S¥() 
. Var 6(t), where 6(z) is a delta | Var/(2m) 
function 
. Var Var 6 (@) 
. Var cos Bt (Var/2) [6 (o-+ 8) +6 (o—8))} 
> Var; cos B;t _ by Var; (5 (o+8;)+6 (o—B))] 
i=1 i=1 
. Var e7@ II (Var a/m)(a?-+ w?)-2 
2 =. 4 = Va jl; 
. Dy Var; oW i! 2a OF 
i=i i= 
a} Vara a2 BPO? 
sn <r Gone tO TOr 
* : a : 
vor o-#181(conpe+E singh) [82 ROE 
" ; V 20? 
Vara 2 (a%?— B?) 


mw = [(a—)?+- 7} [(@-+ 8)? @?] 
+-% sinh 6/71} (a > B) 


_Var_ ( sin (@/2) )’ 


4 (x) is a unit function PAL @/2 
. Var eo @!TI 4+] 71) (Var a/m) 2a3/(@?+ ?)? 
Var a@ a4 


. Var eo elt(tpaltlts ate? | ~ «3 (@2-+a2)3 


Vara  16c%m4 





. Var eW@1 (t-te |r |— 20% Rh (wap 
4 
sei 3 
+z 08/7) | 
. 2a sin Bt/t ai (i—|o |/B) 
in Br 0 for 0<Jo]<B, 
. 24° (2 cos Br—1) a? for B<}o@] < 2p, 
0 for 2B<|o| 
(a1)? Var ( =) . | 
. Vare aE P| oe 


. Var e~%!41 196 (t) a (sign t)?]_ | (Var &/x)[02/(a?+ ©*)) ' 
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